-- Logs begin at Tue 2022-08-23 06:39:00 UTC, end at Tue 2022-08-23 07:24:45 UTC. -- Aug 23 07:10:26.823227 dv-cinder-854070-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 07:10:26.832107 dv-cinder-854070-3-smb devstack@keystone.service[81559]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 07:10:26.834152 dv-cinder-854070-3-smb devstack@keystone.service[81559]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 07:10:26 2022] *** Aug 23 07:10:26.834152 dv-cinder-854070-3-smb devstack@keystone.service[81559]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 07:10:26.834152 dv-cinder-854070-3-smb devstack@keystone.service[81559]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 07:10:26.834152 dv-cinder-854070-3-smb devstack@keystone.service[81559]: nodename: dv-cinder-854070-3-smb Aug 23 07:10:26.834152 dv-cinder-854070-3-smb devstack@keystone.service[81559]: machine: x86_64 Aug 23 07:10:26.834152 dv-cinder-854070-3-smb devstack@keystone.service[81559]: clock source: unix Aug 23 07:10:26.834152 dv-cinder-854070-3-smb devstack@keystone.service[81559]: pcre jit disabled Aug 23 07:10:26.834152 dv-cinder-854070-3-smb devstack@keystone.service[81559]: detected number of CPU cores: 4 Aug 23 07:10:26.834152 dv-cinder-854070-3-smb devstack@keystone.service[81559]: current working directory: / Aug 23 07:10:26.834152 dv-cinder-854070-3-smb devstack@keystone.service[81559]: detected binary path: /usr/bin/uwsgi-core Aug 23 07:10:26.834883 dv-cinder-854070-3-smb devstack@keystone.service[81559]: your processes number limit is 47680 Aug 23 07:10:26.834883 dv-cinder-854070-3-smb devstack@keystone.service[81559]: your memory page size is 4096 bytes Aug 23 07:10:26.834883 dv-cinder-854070-3-smb devstack@keystone.service[81559]: detected max file descriptor number: 2048 Aug 23 07:10:26.834883 dv-cinder-854070-3-smb devstack@keystone.service[81559]: lock engine: pthread robust mutexes Aug 23 07:10:26.834883 dv-cinder-854070-3-smb devstack@keystone.service[81559]: thunder lock: enabled Aug 23 07:10:26.834883 dv-cinder-854070-3-smb devstack@keystone.service[81559]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 07:10:26.834883 dv-cinder-854070-3-smb devstack@keystone.service[81559]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 07:10:26.874583 dv-cinder-854070-3-smb devstack@keystone.service[81559]: Python main interpreter initialized at 0x55ccec7a79c0 Aug 23 07:10:26.874583 dv-cinder-854070-3-smb devstack@keystone.service[81559]: python threads support enabled Aug 23 07:10:26.874583 dv-cinder-854070-3-smb devstack@keystone.service[81559]: your server socket listen backlog is limited to 100 connections Aug 23 07:10:26.874583 dv-cinder-854070-3-smb devstack@keystone.service[81559]: your mercy for graceful operations on workers is 90 seconds Aug 23 07:10:26.874922 dv-cinder-854070-3-smb devstack@keystone.service[81559]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 07:10:26.875006 dv-cinder-854070-3-smb devstack@keystone.service[81559]: *** Operational MODE: preforking *** Aug 23 07:10:26.875259 dv-cinder-854070-3-smb devstack@keystone.service[81559]: *** uWSGI is running in multiple interpreter mode *** Aug 23 07:10:26.875259 dv-cinder-854070-3-smb devstack@keystone.service[81559]: spawned uWSGI master process (pid: 81559) Aug 23 07:10:26.875463 dv-cinder-854070-3-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 23 07:10:26.878148 dv-cinder-854070-3-smb devstack@keystone.service[81559]: spawned uWSGI worker 1 (pid: 81572, cores: 1) Aug 23 07:10:26.878148 dv-cinder-854070-3-smb devstack@keystone.service[81559]: spawned uWSGI worker 2 (pid: 81573, cores: 1) Aug 23 07:10:26.878148 dv-cinder-854070-3-smb devstack@keystone.service[81559]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 07:10:31.218125 dv-cinder-854070-3-smb devstack@keystone.service[81572]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:10:31.218125 dv-cinder-854070-3-smb devstack@keystone.service[81572]: from cryptography.utils import int_from_bytes Aug 23 07:10:31.218942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:10:31.218942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: from cryptography.utils import int_from_bytes Aug 23 07:10:31.219368 dv-cinder-854070-3-smb devstack@keystone.service[81572]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:10:31.219368 dv-cinder-854070-3-smb devstack@keystone.service[81572]: from cryptography.utils import int_from_bytes Aug 23 07:10:31.219471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 07:10:31.219471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: from cryptography.utils import int_from_bytes Aug 23 07:10:31.273061 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 07:10:31.273239 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 07:10:31.273430 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] command line args: [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 07:10:31.274327 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 07:10:31.274496 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ================================================================================ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 07:10:31.274750 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] admin_token = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.275024 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] config_dir = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.275214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.275399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] config_source = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.275581 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] debug = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.275781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.276273 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.276359 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.276573 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.276827 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.277061 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.277240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_config_append = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.277417 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.277595 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_dir = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.277774 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.278018 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.278294 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.278541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.278798 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.278977 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.279154 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.279400 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.279651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.279886 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.280119 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.280355 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.280589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.280835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.281068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 07:10:31.281161 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.281282 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 07:10:31.281393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.281471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] command line args: [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 07:10:31.281721 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 07:10:31.281810 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.281878 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ================================================================================ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 07:10:31.282006 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] publish_errors = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.282168 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] admin_token = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.282274 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.282417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config_dir = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.282505 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.282590 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.282663 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.282738 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] config_source = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.282857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.282981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] debug = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.283091 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.283179 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.283324 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] standard_threads = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.283409 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.283527 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.283601 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.283762 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.283843 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.283947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.284023 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.284123 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] use_journal = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.284221 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.284308 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] use_json = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.284401 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_config_append = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.284484 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] use_stderr = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.284577 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.284659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] use_syslog = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.284735 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_dir = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.284841 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.284919 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.285096 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.285173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.285335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.285413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.285591 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.285673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.285827 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.285909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.286009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.286094 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.286244 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.286330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.286439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.286567 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.286682 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.286808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.286913 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.287056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.287132 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.287314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.287504 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.287673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.287763 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.287830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.288000 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.288081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.288236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.288314 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.288484 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.288560 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.288730 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.288966 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.289048 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.289223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] publish_errors = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.289345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.289562 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.289701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.289842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.289967 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.290053 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.290151 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.290241 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.290391 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.290470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.290627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.290704 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.290861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] standard_threads = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.290949 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.291090 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.291168 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.291331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.291413 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.291490 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.291613 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.291691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_journal = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.291832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_json = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.291914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.291992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_stderr = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.292088 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.292172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] use_syslog = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.292338 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.292415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 07:10:31.292615 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.292691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.292851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.292939 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.293100 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.293177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.293350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.293426 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.293588 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.293673 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.293839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.293915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.294070 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.294211 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.294330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.294420 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.294565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.294647 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.294799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.294885 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.295032 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.295180 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.295260 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.295332 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.295482 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.295559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.295718 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.295804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.295960 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.296036 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.296189 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.296271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.296425 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.296510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.296662 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.296737 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.296897 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.296979 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.297133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.297218 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.297364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.297439 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.297601 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.297682 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.297839 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.297927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.298080 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.298273 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.298362 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.298436 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.298568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.298651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.298796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.298882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.299024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.299137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.299255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.299334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.299497 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.299573 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.299736 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.299848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.299953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.300048 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.300176 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.300292 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.300418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.300528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.300662 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.300775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.300895 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.300982 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.301131 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.301211 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.301356 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.301432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.301588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.301670 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.301821 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.301901 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.302047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.302164 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.302298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.302420 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.302525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.302603 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.302759 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.302839 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.303041 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.303162 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.303264 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.303369 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.303490 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.303572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.303722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.303802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.303949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.304033 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.304179 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.304256 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.304409 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.304488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.304643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.304719 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.304941 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.305078 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.305296 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.305480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.305610 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.305691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.305763 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.305901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.306026 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.306135 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.306253 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.306352 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.306494 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.306587 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.306739 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.306816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.306978 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.307062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.307213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.307365 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.307440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.307518 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.307668 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.307747 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.307904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.307982 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.308136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.308226 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.308367 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.308444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.308601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.308679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.308847 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.308932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.309083 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.309160 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.309328 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.309406 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.309568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.309653 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.309801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.309885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.310033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.310129 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.external = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.310290 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.310393 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.310570 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.310648 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.310806 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.310894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.311037 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.password = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.311123 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.311268 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] auth.token = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.311347 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.311499 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.311576 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.311739 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.311836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.312006 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.312142 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.312234 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.312307 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.312433 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.312526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.312686 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.312762 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.312920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.312997 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.313156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.313247 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.313391 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.313469 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.313628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.313706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.313862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.313948 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.314094 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.314233 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.314341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.314423 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.314560 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.314640 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.314788 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.314875 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.315016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.315094 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.315247 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.315326 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.315475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.315561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.315715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.315812 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.316044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.316153 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.316283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.316372 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.316518 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.316597 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.316770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.316848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.317004 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.317089 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.317242 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.317332 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.317470 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.external = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.317549 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.317699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.317779 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.317939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.318016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.318218 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.318301 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.318449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.password = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.318534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.318677 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] auth.token = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.318757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.318914 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.318992 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.319155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.319236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.319390 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.319468 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.319617 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.319695 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.319860 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.319940 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.320102 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.320181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.320332 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.320906 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.321149 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.321334 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.321476 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.321628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.321759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.321870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.321959 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.322070 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.322204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.322342 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.322464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.322593 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323186 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323264 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323407 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323486 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323640 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323852 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.323950 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.324097 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.324205 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.324341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.324454 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.324597 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.324727 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.324836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.324967 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.325088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.325206 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.325320 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.325439 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.325554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.325678 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.325796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.325912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.326038 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.326182 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.326278 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.326426 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.326506 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.326668 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.326746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.326918 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.327006 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.327158 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.327237 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.327407 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.327501 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.327658 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.327775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.327891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.328024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.328139 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.328258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.328387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.328504 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.328618 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.328748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.328857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.328981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.329088 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.329213 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.329325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.329456 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.329562 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.329683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.329916 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.329995 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.330202 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.330309 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.330448 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.330526 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.330702 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.330782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.330930 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.331008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.331157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.331236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.331391 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.331641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.331718 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.331890 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.331969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.332128 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.332215 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.332365 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.332444 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.332602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.332680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.332835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.332948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.333119 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.333209 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.333337 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.333418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.333660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.333804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.333882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.334032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.334130 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.334289 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.334381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.334554 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.334634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.334787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.334876 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.335021 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.335110 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.335250 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.335329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.335486 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.335563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.335717 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.335805 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.335948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.336705 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.336832 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.336945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.337072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.337222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.337357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.337455 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.337529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.337632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.337748 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.337864 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.337997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.338143 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.338261 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.338362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.338500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.338719 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.338799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.338961 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.339085 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.339305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.339458 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.339547 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.339622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.339693 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.339764 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.339924 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.340003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.340155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.340235 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.340401 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.340516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.340635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.340716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.340863 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.340944 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.341100 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.341179 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.341348 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.341436 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.341580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.341658 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.341812 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.341889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.342051 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.346173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.346173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.346417 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.346493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.346564 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.346647 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.346729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.346803 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.346874 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.346945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347016 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347240 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347382 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347453 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347675 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347747 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347819 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] role.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.347962 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348108 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] role.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348184 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348255 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348326 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348468 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348546 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348620 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348762 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348839 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348912 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.348991 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349207 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349429 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349502 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349573 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349644 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349714 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349785 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349864 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.349938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350203 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350629 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350700 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350770 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350849 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.350993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351063 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351134 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351204 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351204 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351554 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351744 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.351944 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.352049 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.352177 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.352331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.352457 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.352536 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.352536 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.352710 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.352800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.352882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.352956 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353027 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353097 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353168 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353238 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353317 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353390 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353460 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353601 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353671 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.353990 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.354072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.354256 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.354336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.354513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.354594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.354756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.354835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.354991 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.355068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.355233 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.355311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.355461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.355540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.355704 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.355783 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.355940 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.356019 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.356219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.356347 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.356448 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.356529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.356648 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.356821 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.356900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.357056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.357134 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.357304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.357392 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.357549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.357628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.357795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.357873 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.358041 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.358179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.358299 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.358380 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.358547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.358626 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.358796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.358874 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.359112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.359261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.359339 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.359490 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.359568 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.359719 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.359798 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.359963 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.360040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.360201 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.360297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.360443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.360522 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.360676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.360762 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.360906 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.360989 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.361133 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.361213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.361365 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.361443 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.361596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.361673 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.361836 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.361916 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.362065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.362160 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.362262 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81572) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 07:10:31.362341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.362571 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.362813 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.363053 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.363293 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.363580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.363811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.364047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.364278 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.364523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.364766 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.364994 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.365232 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.365525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.365782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.366022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.366289 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.366523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.366759 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.366990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.367245 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.367624 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.367891 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.368136 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.368371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.368613 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.368847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.369092 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.369325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.369566 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.369794 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.370031 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.370336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 07:10:31.370508 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81573) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 07:10:31.392112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.392348 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.392572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.401657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.405427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.405662 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.405887 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.414651 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.431120 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.431351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.433324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.433556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.493015 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.493166 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.543399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.543577 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.543672 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.543804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.715294 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.715530 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.715747 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.715968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.716058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.716185 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.716336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.716425 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.716501 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.716602 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.716816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.717027 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.743272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.743390 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.743459 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.743574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.743673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.743801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.743886 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.744025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.744108 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.744243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.744328 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.744471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.744554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.744695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.755693 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.755924 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.768596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.768830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.768925 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.769051 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.769153 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.769272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.769358 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.769489 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.769573 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.769706 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.769789 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.769918 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81572) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.770002 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.770146 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81573) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 07:10:31.792781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.792909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.792990 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 07:10:31.793094 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 07:10:31.793317 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.793432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.793526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 07:10:31.793631 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 07:10:31.793776 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.793906 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.794039 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.794195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.794455 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.794570 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.794709 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.794833 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.804212 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.804488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.804663 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.804865 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.805079 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.805334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.805420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.805626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.812411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.812643 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.815316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.815557 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.815656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.815839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.815925 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.816125 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.816208 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.816408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.816493 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.816669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.816761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.816935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.817068 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.817204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.817286 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.817475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.817623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.817800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.817895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.818075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.818185 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.818364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.841815 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.842242 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.843300 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.843584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.843667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.843865 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.848581 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.848852 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.848939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.849133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.849217 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.849414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.856404 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.856509 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.856688 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.858112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.860842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.860959 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.861128 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.861213 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.861408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.861491 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.861692 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.861776 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.861966 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.862049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.862265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.862350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.862536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.862621 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.862801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.862882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.880149 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.885516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.885642 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.885642 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.885815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.885907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.887649 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.887946 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.888118 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.888414 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.892204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.892675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.895351 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.895807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.899272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.899571 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.899859 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.899958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.900143 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.900227 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.900419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.900504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.900715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.900800 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.901040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.901331 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.917469 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.921182 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.921182 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.921396 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.921477 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.921565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.921565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.921565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.925179 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.925783 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.926723 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.927003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.927348 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.927623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.929660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.930069 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.930392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.930536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.930682 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.930824 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.930959 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.931125 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.931421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.931700 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.942851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.943130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.943215 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.943408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.943493 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.943686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.943769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.943964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.944057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.944240 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.944324 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.944513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.944604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.944792 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.960679 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.961589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.964625 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.964942 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.967595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.967920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.969018 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.969359 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.970508 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.971062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.971166 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.971358 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.971442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.971673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.978112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.978507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.979612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.979947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.982507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.982799 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.982882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.983095 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.983205 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.983407 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.983497 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.983689 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.991424 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.991709 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.991795 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.991991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.992085 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.992403 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.999286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81573) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.999512 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.999679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81572) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 07:10:31.999774 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:31.999963 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.000048 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.000246 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.000330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.000525 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.000618 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.000803 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.000886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.001089 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.001180 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.001362 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.001446 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.001632 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.001714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.001965 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.002072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.002226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.002310 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.002501 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.002583 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.002769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81573) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.007236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.007236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.007236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81572) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 07:10:32.038313 dv-cinder-854070-3-smb devstack@keystone.service[81573]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ccec7a79c0 pid: 81573 (default app) Aug 23 07:10:32.038786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ccec7a79c0 pid: 81572 (default app) Aug 23 07:10:32.042024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970230-c9c0-4d13-b25a-0806aa809cfa None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:32.042327 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970230-c9c0-4d13-b25a-0806aa809cfa None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:32.042594 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970230-c9c0-4d13-b25a-0806aa809cfa None None] PATH_INFO: `/v3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:32.046693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Tue Aug 23 07:10:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:10:39.491070 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452047cf-5963-4684-8bc8-e93692fab588 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:39.491620 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452047cf-5963-4684-8bc8-e93692fab588 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:39.491620 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452047cf-5963-4684-8bc8-e93692fab588 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:39.496046 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:10:39.502441 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83d2bd-1eba-4ef8-9c91-db76b1458d86 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:39.502864 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83d2bd-1eba-4ef8-9c91-db76b1458d86 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:39.502993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83d2bd-1eba-4ef8-9c91-db76b1458d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:39.575122 dv-cinder-854070-3-smb devstack@keystone.service[81573]: INFO dbcounter [None req-9e83d2bd-1eba-4ef8-9c91-db76b1458d86 None None] Registered counter for database keystone Aug 23 07:10:39.594744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG oslo_db.sqlalchemy.engines [None req-9e83d2bd-1eba-4ef8-9c91-db76b1458d86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81573) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:10:39.601308 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writer thread running {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:10:39.783681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG passlib.handlers.bcrypt [None req-9e83d2bd-1eba-4ef8-9c91-db76b1458d86 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81573) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 07:10:39.784009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG passlib.handlers.bcrypt [None req-9e83d2bd-1eba-4ef8-9c91-db76b1458d86 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81573) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 07:10:39.839343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9e83d2bd-1eba-4ef8-9c91-db76b1458d86 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:39.840974 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9e83d2bd-1eba-4ef8-9c91-db76b1458d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:39.969623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 07:10:40.431118 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452047cf-5963-4684-8bc8-e93692fab588 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:40.499993 dv-cinder-854070-3-smb devstack@keystone.service[81572]: INFO dbcounter [None req-452047cf-5963-4684-8bc8-e93692fab588 None None] Registered counter for database keystone Aug 23 07:10:40.521277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG oslo_db.sqlalchemy.engines [None req-452047cf-5963-4684-8bc8-e93692fab588 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81572) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 07:10:40.527472 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writer thread running {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 07:10:40.645583 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452047cf-5963-4684-8bc8-e93692fab588 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:40.650452 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147be502-425c-4f32-b447-e38de81ad241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '446e3fa3333244a786f2fbb60ab9e0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:40.651066 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147be502-425c-4f32-b447-e38de81ad241 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:40.651344 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147be502-425c-4f32-b447-e38de81ad241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:40.651614 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147be502-425c-4f32-b447-e38de81ad241 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:40.659560 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147be502-425c-4f32-b447-e38de81ad241 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:40.710962 dv-cinder-854070-3-smb devstack@keystone.service[81572]: WARNING keystone.common.rbac_enforcer.enforcer [None req-147be502-425c-4f32-b447-e38de81ad241 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 07:10:40.711214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147be502-425c-4f32-b447-e38de81ad241 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:40.720811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Aug 23 07:10:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 07:10:40.727489 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83d2bd-1eba-4ef8-9c91-db76b1458d86 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:40.741626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83d2bd-1eba-4ef8-9c91-db76b1458d86 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:40.746010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87314502-d043-43f2-895e-ab8fd9fa2b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '446e3fa3333244a786f2fbb60ab9e0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:40.747152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314502-d043-43f2-895e-ab8fd9fa2b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:40.747430 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314502-d043-43f2-895e-ab8fd9fa2b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:40.747694 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87314502-d043-43f2-895e-ab8fd9fa2b76 admin admin] PATH_INFO: `/v3/projects/446e3fa3333244a786f2fbb60ab9e0a2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:40.749214 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87314502-d043-43f2-895e-ab8fd9fa2b76 admin admin] RBAC: Authorizing `identity:get_project(project_id=446e3fa3333244a786f2fbb60ab9e0a2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:40.806515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: WARNING keystone.common.rbac_enforcer.enforcer [None req-87314502-d043-43f2-895e-ab8fd9fa2b76 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 07:10:40.806854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87314502-d043-43f2-895e-ab8fd9fa2b76 admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:40.811610 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Tue Aug 23 07:10:40 2022] GET /identity/v3/projects/446e3fa3333244a786f2fbb60ab9e0a2 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:10:42.695643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2f25-17b9-4fe6-83af-bea7386c6f51 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:42.696173 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2f25-17b9-4fe6-83af-bea7386c6f51 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:42.696264 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a2f25-17b9-4fe6-83af-bea7386c6f51 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:42.700323 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:10:42.705763 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af501639-3597-473b-b655-a24d39323298 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:42.706158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af501639-3597-473b-b655-a24d39323298 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:42.706351 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af501639-3597-473b-b655-a24d39323298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:42.726657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-af501639-3597-473b-b655-a24d39323298 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:42.728156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-af501639-3597-473b-b655-a24d39323298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:42.735839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 07:10:43.003894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2f25-17b9-4fe6-83af-bea7386c6f51 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:43.016625 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a2f25-17b9-4fe6-83af-bea7386c6f51 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:43.020745 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361eb03f-4582-4a58-9209-d965ba865909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '446e3fa3333244a786f2fbb60ab9e0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:43.021334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eb03f-4582-4a58-9209-d965ba865909 admin admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:43.021621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eb03f-4582-4a58-9209-d965ba865909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:43.021893 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361eb03f-4582-4a58-9209-d965ba865909 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:43.029595 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361eb03f-4582-4a58-9209-d965ba865909 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:43.031375 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361eb03f-4582-4a58-9209-d965ba865909 admin admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:43.040327 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Tue Aug 23 07:10:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 07:10:43.045566 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af501639-3597-473b-b655-a24d39323298 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:43.055207 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af501639-3597-473b-b655-a24d39323298 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:43.059494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec5055-2cf2-453a-a1db-390f7618723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '446e3fa3333244a786f2fbb60ab9e0a2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:43.060110 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5055-2cf2-453a-a1db-390f7618723c admin admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:43.060385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5055-2cf2-453a-a1db-390f7618723c admin admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:43.060651 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec5055-2cf2-453a-a1db-390f7618723c admin admin] PATH_INFO: `/v3/users/97d2196009fa44f294707c6fd6554a9d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:43.061933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5055-2cf2-453a-a1db-390f7618723c admin admin] RBAC: Authorizing `identity:get_user(user_id=97d2196009fa44f294707c6fd6554a9d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:43.063779 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec5055-2cf2-453a-a1db-390f7618723c admin admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:43.065610 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Tue Aug 23 07:10:43 2022] GET /identity/v3/users/97d2196009fa44f294707c6fd6554a9d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:10:45.033061 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685cc73-05e6-4166-8662-54dc33f5aac4 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:45.033622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685cc73-05e6-4166-8662-54dc33f5aac4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:45.033622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685cc73-05e6-4166-8662-54dc33f5aac4 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:45.034960 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:10:45.040816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740912a-75b2-4039-b9c8-81e3c365a65a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:45.041238 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740912a-75b2-4039-b9c8-81e3c365a65a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:45.041377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740912a-75b2-4039-b9c8-81e3c365a65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:45.059694 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f740912a-75b2-4039-b9c8-81e3c365a65a None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:45.060880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f740912a-75b2-4039-b9c8-81e3c365a65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:45.083478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f69ed-f95c-4a62-9bb1-403df3b69b85 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:45.083770 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f69ed-f95c-4a62-9bb1-403df3b69b85 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:45.084046 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f69ed-f95c-4a62-9bb1-403df3b69b85 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:45.086064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:10:45.091359 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7d111-7ace-4928-b675-a76917526089 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:45.091649 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7d111-7ace-4928-b675-a76917526089 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:45.091922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7d111-7ace-4928-b675-a76917526089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:45.133684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG passlib.handlers.bcrypt [None req-e1c7d111-7ace-4928-b675-a76917526089 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81572) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 07:10:45.134141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG passlib.handlers.bcrypt [None req-e1c7d111-7ace-4928-b675-a76917526089 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81572) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 07:10:45.141049 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:10:45.180106 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e1c7d111-7ace-4928-b675-a76917526089 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:45.181681 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e1c7d111-7ace-4928-b675-a76917526089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:45.278119 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:10:45.406012 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740912a-75b2-4039-b9c8-81e3c365a65a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:45.430423 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:45.511283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740912a-75b2-4039-b9c8-81e3c365a65a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:45.543745 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7d111-7ace-4928-b675-a76917526089 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:45.545607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd4fba-59a5-466c-817a-c3466e871c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:45.546269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd4fba-59a5-466c-817a-c3466e871c0d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:45.546548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd4fba-59a5-466c-817a-c3466e871c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:45.547491 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd4fba-59a5-466c-817a-c3466e871c0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:45.557847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd4fba-59a5-466c-817a-c3466e871c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3bbd4fba-59a5-466c-817a-c3466e871c0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:10:45.566529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:10:45.567434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:10:45.568269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:10:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:10:45.574029 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd4fba-59a5-466c-817a-c3466e871c0d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:45.651057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7d111-7ace-4928-b675-a76917526089 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:45.653374 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:45.658520 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:45.675838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd4fba-59a5-466c-817a-c3466e871c0d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:45.689461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15bea8-f2a6-4b6a-ba13-79471889ef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:45.690426 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15bea8-f2a6-4b6a-ba13-79471889ef14 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:45.690714 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15bea8-f2a6-4b6a-ba13-79471889ef14 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:45.690986 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15bea8-f2a6-4b6a-ba13-79471889ef14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:45.711392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9469be-40c6-47a0-9730-5ce8be39bb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:45.712027 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9469be-40c6-47a0-9730-5ce8be39bb1b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:45.712307 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9469be-40c6-47a0-9730-5ce8be39bb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:45.712575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9469be-40c6-47a0-9730-5ce8be39bb1b None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:45.713237 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9469be-40c6-47a0-9730-5ce8be39bb1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:10:45.713550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9469be-40c6-47a0-9730-5ce8be39bb1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:45.714963 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9469be-40c6-47a0-9730-5ce8be39bb1b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:45.727039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:10:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:10:45.732509 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9469be-40c6-47a0-9730-5ce8be39bb1b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:45.759729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15bea8-f2a6-4b6a-ba13-79471889ef14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:45.761249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15bea8-f2a6-4b6a-ba13-79471889ef14 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:45.830241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9469be-40c6-47a0-9730-5ce8be39bb1b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:45.857791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 8/16] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:10:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 07:10:45.863300 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15bea8-f2a6-4b6a-ba13-79471889ef14 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:45.864582 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e75c4-7e21-44a7-a163-5e04921edfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:45.865212 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e75c4-7e21-44a7-a163-5e04921edfe8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:45.865487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e75c4-7e21-44a7-a163-5e04921edfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:45.865761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e75c4-7e21-44a7-a163-5e04921edfe8 None admin] PATH_INFO: `/v3/users/97d2196009fa44f294707c6fd6554a9d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:45.865988 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:45.867449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e75c4-7e21-44a7-a163-5e04921edfe8 None admin] RBAC: Authorizing `identity:get_user(user_id=97d2196009fa44f294707c6fd6554a9d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:45.868894 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e75c4-7e21-44a7-a163-5e04921edfe8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:45.870477 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:10:45 2022] GET /identity/v3/users/97d2196009fa44f294707c6fd6554a9d => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:10:45.875821 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e75c4-7e21-44a7-a163-5e04921edfe8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:45.891014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:45.963005 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15bea8-f2a6-4b6a-ba13-79471889ef14 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:45.975500 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e75c4-7e21-44a7-a163-5e04921edfe8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:45.996370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e28c5e-1e38-4632-b737-5b0e90d0dff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:45.997214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e28c5e-1e38-4632-b737-5b0e90d0dff1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:45.997495 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e28c5e-1e38-4632-b737-5b0e90d0dff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:45.997768 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e28c5e-1e38-4632-b737-5b0e90d0dff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:46.010295 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887c864-4040-4715-bdfb-cec2791a9c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:46.011124 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887c864-4040-4715-bdfb-cec2791a9c02 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:46.011400 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887c864-4040-4715-bdfb-cec2791a9c02 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:46.011670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887c864-4040-4715-bdfb-cec2791a9c02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:46.012779 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887c864-4040-4715-bdfb-cec2791a9c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:46.014250 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887c864-4040-4715-bdfb-cec2791a9c02 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:46.015955 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:10:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:10:46.016746 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e28c5e-1e38-4632-b737-5b0e90d0dff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:46.018227 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e28c5e-1e38-4632-b737-5b0e90d0dff1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:46.021484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887c864-4040-4715-bdfb-cec2791a9c02 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-26e28c5e-1e38-4632-b737-5b0e90d0dff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:10:46.036393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:10:46.037609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:10:46.038523 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:10:46.038523 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:10:46.038523 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:10:46.038523 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:10:46.043291 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e28c5e-1e38-4632-b737-5b0e90d0dff1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:46.101626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:46.104204 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:46.120992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887c864-4040-4715-bdfb-cec2791a9c02 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:46.148190 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e28c5e-1e38-4632-b737-5b0e90d0dff1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:46.155478 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523e07c-b7b0-48b4-ac52-0b4f1d2bc680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:46.156082 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523e07c-b7b0-48b4-ac52-0b4f1d2bc680 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:46.156359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523e07c-b7b0-48b4-ac52-0b4f1d2bc680 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:46.156628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523e07c-b7b0-48b4-ac52-0b4f1d2bc680 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:46.157348 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523e07c-b7b0-48b4-ac52-0b4f1d2bc680 None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.domain.id=default, user.id=97d2196009fa44f294707c6fd6554a9d) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:10:46.157648 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523e07c-b7b0-48b4-ac52-0b4f1d2bc680 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:46.159124 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523e07c-b7b0-48b4-ac52-0b4f1d2bc680 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:46.166218 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Tue Aug 23 07:10:46 2022] GET /identity/v3/role_assignments?user.id=97d2196009fa44f294707c6fd6554a9d&scope.domain.id=default&role.id=afe88bc03d30494b89892587177c79de => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:10:46.183172 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bee8e3-8c89-4bac-a986-813a2c8bd036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:46.183791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bee8e3-8c89-4bac-a986-813a2c8bd036 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:46.184078 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bee8e3-8c89-4bac-a986-813a2c8bd036 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:46.184349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bee8e3-8c89-4bac-a986-813a2c8bd036 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:46.185019 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bee8e3-8c89-4bac-a986-813a2c8bd036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:10:46.185321 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bee8e3-8c89-4bac-a986-813a2c8bd036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:46.186801 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bee8e3-8c89-4bac-a986-813a2c8bd036 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:46.206847 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:10:48.318978 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc565-9e58-4552-836c-3147d3c1ac3e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:48.320579 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc565-9e58-4552-836c-3147d3c1ac3e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:48.321074 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdc565-9e58-4552-836c-3147d3c1ac3e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:48.322640 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:10:48.328078 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c43d4-4287-4ec9-9728-5bb90acdc46c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:48.328936 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c43d4-4287-4ec9-9728-5bb90acdc46c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:48.329426 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c43d4-4287-4ec9-9728-5bb90acdc46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:48.359434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-090c43d4-4287-4ec9-9728-5bb90acdc46c None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:48.360647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-090c43d4-4287-4ec9-9728-5bb90acdc46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:48.452159 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:10:48.472666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621363a-3120-4f9c-81cd-80e96d49ec38 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:48.473254 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621363a-3120-4f9c-81cd-80e96d49ec38 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:48.473726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621363a-3120-4f9c-81cd-80e96d49ec38 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:48.475264 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:10:48.480594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8174f-46e3-459b-bc76-4733541ec2ac None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:48.481093 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8174f-46e3-459b-bc76-4733541ec2ac None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:48.481576 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d8174f-46e3-459b-bc76-4733541ec2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:48.503132 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-81d8174f-46e3-459b-bc76-4733541ec2ac None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:48.504639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-81d8174f-46e3-459b-bc76-4733541ec2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:48.560025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:48.607427 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:10:48.857292 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621363a-3120-4f9c-81cd-80e96d49ec38 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:48.891678 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54eb8f-0f80-46bc-b746-4f0c797b9a35 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:48.892194 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54eb8f-0f80-46bc-b746-4f0c797b9a35 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:48.892638 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54eb8f-0f80-46bc-b746-4f0c797b9a35 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:48.894176 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 13/26] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:10:48.899713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22719ef-089b-455e-b700-bb2d27133e51 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:48.900000 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22719ef-089b-455e-b700-bb2d27133e51 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:48.900275 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22719ef-089b-455e-b700-bb2d27133e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:48.931136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f22719ef-089b-455e-b700-bb2d27133e51 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:48.932365 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f22719ef-089b-455e-b700-bb2d27133e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:49.030869 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621363a-3120-4f9c-81cd-80e96d49ec38 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:49.086934 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbca7b-891f-4880-a3a0-0773fbfc461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:49.087586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbca7b-891f-4880-a3a0-0773fbfc461e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:49.087869 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbca7b-891f-4880-a3a0-0773fbfc461e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:49.088144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbca7b-891f-4880-a3a0-0773fbfc461e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:49.099683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbca7b-891f-4880-a3a0-0773fbfc461e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e5dbca7b-891f-4880-a3a0-0773fbfc461e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:10:49.104964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:10:49.105795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:10:49.106568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 14/27] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:10:49.107265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbca7b-891f-4880-a3a0-0773fbfc461e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:49.115853 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:49.118156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:10:49.119593 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc661f2b-2f52-4d19-b96f-71077fdc5703 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:49.119882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc661f2b-2f52-4d19-b96f-71077fdc5703 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:49.120158 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc661f2b-2f52-4d19-b96f-71077fdc5703 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:49.121682 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 15/29] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:10:49.122412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc661f2b-2f52-4d19-b96f-71077fdc5703 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:49.238122 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc661f2b-2f52-4d19-b96f-71077fdc5703 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:49.246356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:49.276647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0020c3-d5fe-44a7-a946-f457964c81a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:49.277313 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0020c3-d5fe-44a7-a946-f457964c81a1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:49.277597 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0020c3-d5fe-44a7-a946-f457964c81a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:49.277865 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0020c3-d5fe-44a7-a946-f457964c81a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:49.278287 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbca7b-891f-4880-a3a0-0773fbfc461e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:49.279453 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0020c3-d5fe-44a7-a946-f457964c81a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:10:49.279453 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0020c3-d5fe-44a7-a946-f457964c81a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:49.280520 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0020c3-d5fe-44a7-a946-f457964c81a1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:49.294491 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 16/30] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:10:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:10:49.295844 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea613df-31f8-4d69-98f8-0c78b62c09c7 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:49.296128 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea613df-31f8-4d69-98f8-0c78b62c09c7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:49.296426 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea613df-31f8-4d69-98f8-0c78b62c09c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:49.321027 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-bea613df-31f8-4d69-98f8-0c78b62c09c7 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:49.322363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-bea613df-31f8-4d69-98f8-0c78b62c09c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:49.346807 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aee8aa-0393-4866-a8e9-c0e2e5b81043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:49.347467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aee8aa-0393-4866-a8e9-c0e2e5b81043 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:49.347725 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aee8aa-0393-4866-a8e9-c0e2e5b81043 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:49.348000 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aee8aa-0393-4866-a8e9-c0e2e5b81043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:49.365940 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aee8aa-0393-4866-a8e9-c0e2e5b81043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:49.370548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aee8aa-0393-4866-a8e9-c0e2e5b81043 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c8aee8aa-0393-4866-a8e9-c0e2e5b81043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:10:49.392258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:10:49.394362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:10:49.396387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:10:49.396387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:10:49.396387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:10:49.397459 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 15/31] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:10:49.398265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aee8aa-0393-4866-a8e9-c0e2e5b81043 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:49.409663 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 17/32] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:10:49.410574 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea613df-31f8-4d69-98f8-0c78b62c09c7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:49.523106 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:49.603290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aee8aa-0393-4866-a8e9-c0e2e5b81043 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:49.605757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:49.613058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea613df-31f8-4d69-98f8-0c78b62c09c7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:49.645497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2405b5-be79-41de-964b-90598ce0bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:49.646502 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2405b5-be79-41de-964b-90598ce0bd42 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:49.646989 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2405b5-be79-41de-964b-90598ce0bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:49.648901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2405b5-be79-41de-964b-90598ce0bd42 None admin] PATH_INFO: `/v3/users/97d2196009fa44f294707c6fd6554a9d` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:49.650356 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2405b5-be79-41de-964b-90598ce0bd42 None admin] RBAC: Authorizing `identity:get_user(user_id=97d2196009fa44f294707c6fd6554a9d)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:49.652166 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2405b5-be79-41de-964b-90598ce0bd42 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:49.654386 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 16/33] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:10:49 2022] GET /identity/v3/users/97d2196009fa44f294707c6fd6554a9d => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:10:49.655673 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2405b5-be79-41de-964b-90598ce0bd42 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:49.680330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb09839-fa6f-47df-a84e-bbc89fca882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:49.680998 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb09839-fa6f-47df-a84e-bbc89fca882b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:49.681283 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb09839-fa6f-47df-a84e-bbc89fca882b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:49.681554 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb09839-fa6f-47df-a84e-bbc89fca882b None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:49.682239 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb09839-fa6f-47df-a84e-bbc89fca882b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:10:49.682544 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb09839-fa6f-47df-a84e-bbc89fca882b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:49.684032 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb09839-fa6f-47df-a84e-bbc89fca882b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:49.707260 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 18/34] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:10:49.708636 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb09839-fa6f-47df-a84e-bbc89fca882b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:49.808915 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2405b5-be79-41de-964b-90598ce0bd42 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:49.833568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:49.844607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cb2f3-671c-4837-9755-7d77cb6b2584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:49.845499 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb2f3-671c-4837-9755-7d77cb6b2584 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:49.845782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb2f3-671c-4837-9755-7d77cb6b2584 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:49.846135 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cb2f3-671c-4837-9755-7d77cb6b2584 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:49.846733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cb2f3-671c-4837-9755-7d77cb6b2584 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:49.848103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cb2f3-671c-4837-9755-7d77cb6b2584 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:49.858758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb09839-fa6f-47df-a84e-bbc89fca882b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:49.895077 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cc70f-9939-4a72-9097-6b9112256bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:49.895753 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cc70f-9939-4a72-9097-6b9112256bdd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:49.895977 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cc70f-9939-4a72-9097-6b9112256bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:49.896241 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cc70f-9939-4a72-9097-6b9112256bdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:49.898210 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cc70f-9939-4a72-9097-6b9112256bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:49.899663 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cc70f-9939-4a72-9097-6b9112256bdd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:49.901229 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 19/35] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:10:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:10:49.902009 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cc70f-9939-4a72-9097-6b9112256bdd None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:49.931151 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:50.006275 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cc70f-9939-4a72-9097-6b9112256bdd None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:50.040556 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357690b5-576d-48ea-ba93-89e9c1937437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:50.041152 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357690b5-576d-48ea-ba93-89e9c1937437 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:50.041428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357690b5-576d-48ea-ba93-89e9c1937437 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:50.041694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357690b5-576d-48ea-ba93-89e9c1937437 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:50.042355 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357690b5-576d-48ea-ba93-89e9c1937437 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:50.043788 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357690b5-576d-48ea-ba93-89e9c1937437 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:50.054679 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 17/36] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 23 07:10:49 2022] POST /identity/v3/roles => generated 219 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:10:50.056387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cb2f3-671c-4837-9755-7d77cb6b2584 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:50.186695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cb2f3-671c-4837-9755-7d77cb6b2584 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:50.224742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0e52f-9fe8-4eca-9e9c-25053425bbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:50.225844 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e52f-9fe8-4eca-9e9c-25053425bbfc None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:50.226367 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e52f-9fe8-4eca-9e9c-25053425bbfc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:50.226835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e52f-9fe8-4eca-9e9c-25053425bbfc None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:50.227691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0e52f-9fe8-4eca-9e9c-25053425bbfc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:50.229413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0e52f-9fe8-4eca-9e9c-25053425bbfc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:50.259449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 20/37] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:10:49 2022] POST /identity/v3/projects => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:10:50.260709 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ebdb2-818f-4900-9281-519f78f449e5 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:50.261002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ebdb2-818f-4900-9281-519f78f449e5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:50.261283 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ebdb2-818f-4900-9281-519f78f449e5 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:50.262829 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 21/38] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:10:50.263561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ebdb2-818f-4900-9281-519f78f449e5 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:50.304860 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 18/39] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 23 07:10:50 2022] POST /identity/v3/roles => generated 225 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:10:50.307239 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c2f55-acdb-495f-b5bf-a0651b954f26 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:50.308030 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c2f55-acdb-495f-b5bf-a0651b954f26 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:50.308667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c2f55-acdb-495f-b5bf-a0651b954f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:50.335737 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-de7c2f55-acdb-495f-b5bf-a0651b954f26 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:50.337804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-de7c2f55-acdb-495f-b5bf-a0651b954f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:50.374446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:50.402601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:50.404014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ebdb2-818f-4900-9281-519f78f449e5 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:50.429709 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 19/40] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:10:50.432057 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50287cb-8e5d-433b-9d42-b36d8bd708dc None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:50.432637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50287cb-8e5d-433b-9d42-b36d8bd708dc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:50.433080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50287cb-8e5d-433b-9d42-b36d8bd708dc None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:50.434964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 20/41] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:10:50.440917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d690-b31d-4da5-a8e2-83b0ad84b3e2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:50.441493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d690-b31d-4da5-a8e2-83b0ad84b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:50.441986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84d690-b31d-4da5-a8e2-83b0ad84b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:50.447354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70126241-1bad-4783-80e8-69ccd4730699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:50.448118 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70126241-1bad-4783-80e8-69ccd4730699 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:50.448409 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70126241-1bad-4783-80e8-69ccd4730699 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:50.448690 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70126241-1bad-4783-80e8-69ccd4730699 None admin] PATH_INFO: `/v3/domains/default/users/97d2196009fa44f294707c6fd6554a9d/roles/afe88bc03d30494b89892587177c79de` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:50.451312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70126241-1bad-4783-80e8-69ccd4730699 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=97d2196009fa44f294707c6fd6554a9d, role_id=afe88bc03d30494b89892587177c79de)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:50.452978 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70126241-1bad-4783-80e8-69ccd4730699 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:50.553081 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 22/42] 10.222.0.16 () {58 vars in 1361 bytes} [Tue Aug 23 07:10:50 2022] PUT /identity/v3/domains/default/users/97d2196009fa44f294707c6fd6554a9d/roles/afe88bc03d30494b89892587177c79de => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:10:50.573895 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bb84d690-b31d-4da5-a8e2-83b0ad84b3e2 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:50.575548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bb84d690-b31d-4da5-a8e2-83b0ad84b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:50.657012 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 21/43] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:10:50.725886 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70126241-1bad-4783-80e8-69ccd4730699 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:50.828496 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70126241-1bad-4783-80e8-69ccd4730699 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:50.863325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad07c-397d-409a-9595-832d0c090ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:50.863941 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad07c-397d-409a-9595-832d0c090ec3 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:50.864222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad07c-397d-409a-9595-832d0c090ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:50.864501 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad07c-397d-409a-9595-832d0c090ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:50.865180 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ad07c-397d-409a-9595-832d0c090ec3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:50.867338 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ad07c-397d-409a-9595-832d0c090ec3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:50.932033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84d690-b31d-4da5-a8e2-83b0ad84b3e2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:50.940328 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:50.946422 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 23 07:10:50 2022] POST /identity/v3/roles => generated 223 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:10:51.053240 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84d690-b31d-4da5-a8e2-83b0ad84b3e2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:51.057516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:51.095587 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1e751-ad3a-4e53-bbcc-a4373c87df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:51.095587 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1e751-ad3a-4e53-bbcc-a4373c87df26 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:51.095838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1e751-ad3a-4e53-bbcc-a4373c87df26 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:51.096098 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1e751-ad3a-4e53-bbcc-a4373c87df26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:51.097237 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1e751-ad3a-4e53-bbcc-a4373c87df26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:51.098744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd1e751-ad3a-4e53-bbcc-a4373c87df26 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:51.101165 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 22/45] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:10:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:10:51.106839 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad07c-397d-409a-9595-832d0c090ec3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:51.214500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad07c-397d-409a-9595-832d0c090ec3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:51.248345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016afc15-c4aa-4646-a163-aa82171bd93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:51.248954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016afc15-c4aa-4646-a163-aa82171bd93e None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:51.249240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016afc15-c4aa-4646-a163-aa82171bd93e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:51.249517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016afc15-c4aa-4646-a163-aa82171bd93e None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:51.250194 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016afc15-c4aa-4646-a163-aa82171bd93e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:51.251640 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016afc15-c4aa-4646-a163-aa82171bd93e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:51.322576 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:10:51 2022] POST /identity/v3/projects => generated 312 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:10:52.533751 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7fc4d-cef7-4e94-9069-0105e01b3fa5 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:52.534286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7fc4d-cef7-4e94-9069-0105e01b3fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:52.534395 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7fc4d-cef7-4e94-9069-0105e01b3fa5 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:52.535703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 23/47] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:10:52.541619 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18619a8-9c3f-4694-95b1-ac65615e6a23 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:52.542007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18619a8-9c3f-4694-95b1-ac65615e6a23 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:52.542206 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18619a8-9c3f-4694-95b1-ac65615e6a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:52.560828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c18619a8-9c3f-4694-95b1-ac65615e6a23 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:52.562354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c18619a8-9c3f-4694-95b1-ac65615e6a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:52.613312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:52.633565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 25/48] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:10:52.904786 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7fc4d-cef7-4e94-9069-0105e01b3fa5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:53.007604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7fc4d-cef7-4e94-9069-0105e01b3fa5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:53.041354 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fe0a6-87c8-4007-b66d-665ab253c2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:53.041986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe0a6-87c8-4007-b66d-665ab253c2fe None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:53.042295 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe0a6-87c8-4007-b66d-665ab253c2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:53.042568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fe0a6-87c8-4007-b66d-665ab253c2fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:53.052438 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4fe0a6-87c8-4007-b66d-665ab253c2fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-cf4fe0a6-87c8-4007-b66d-665ab253c2fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:10:53.057463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:10:53.058486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:10:53.059693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 24/49] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:10:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:10:53.064396 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18619a8-9c3f-4694-95b1-ac65615e6a23 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:53.238982 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a823b-b693-4378-8983-1cb0ce14a78a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:53.239226 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a823b-b693-4378-8983-1cb0ce14a78a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:53.239456 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67a823b-b693-4378-8983-1cb0ce14a78a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:53.241003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 25/50] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:10:53.245840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf69c35-82a3-4af9-8729-1a15b8508787 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:53.246231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf69c35-82a3-4af9-8729-1a15b8508787 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:53.246508 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf69c35-82a3-4af9-8729-1a15b8508787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:53.264660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5bf69c35-82a3-4af9-8729-1a15b8508787 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:53.265849 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5bf69c35-82a3-4af9-8729-1a15b8508787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:53.273310 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18619a8-9c3f-4694-95b1-ac65615e6a23 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:53.293204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:53.307826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95176c65-361a-46e7-8da7-67f15617dcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:53.308441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95176c65-361a-46e7-8da7-67f15617dcdf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:53.308728 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95176c65-361a-46e7-8da7-67f15617dcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:53.309006 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95176c65-361a-46e7-8da7-67f15617dcdf None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:53.309712 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95176c65-361a-46e7-8da7-67f15617dcdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:10:53.310016 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95176c65-361a-46e7-8da7-67f15617dcdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:53.311428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95176c65-361a-46e7-8da7-67f15617dcdf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:53.324610 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 26/51] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:10:53.325629 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95176c65-361a-46e7-8da7-67f15617dcdf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:53.335978 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 26/52] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:10:53.368589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:53.423461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95176c65-361a-46e7-8da7-67f15617dcdf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:53.456381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f1cfc-9634-4e0e-8257-a5b17ac1ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:53.457006 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f1cfc-9634-4e0e-8257-a5b17ac1ff13 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:53.457289 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f1cfc-9634-4e0e-8257-a5b17ac1ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:53.457563 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f1cfc-9634-4e0e-8257-a5b17ac1ff13 None admin] PATH_INFO: `/v3/users/97d2196009fa44f294707c6fd6554a9d` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:53.458719 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f1cfc-9634-4e0e-8257-a5b17ac1ff13 None admin] RBAC: Authorizing `identity:get_user(user_id=97d2196009fa44f294707c6fd6554a9d)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:53.460211 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f1cfc-9634-4e0e-8257-a5b17ac1ff13 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:53.461780 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:10:53 2022] GET /identity/v3/users/97d2196009fa44f294707c6fd6554a9d => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:10:53.467451 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf69c35-82a3-4af9-8729-1a15b8508787 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:53.563770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf69c35-82a3-4af9-8729-1a15b8508787 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:53.598496 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00868-9136-486f-9a37-2a94a13ab858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:53.599136 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00868-9136-486f-9a37-2a94a13ab858 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:53.599422 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00868-9136-486f-9a37-2a94a13ab858 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:53.599697 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00868-9136-486f-9a37-2a94a13ab858 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:53.600829 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00868-9136-486f-9a37-2a94a13ab858 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:53.602323 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c00868-9136-486f-9a37-2a94a13ab858 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:53.603905 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 27/54] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:10:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:10:53.604518 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f1cfc-9634-4e0e-8257-a5b17ac1ff13 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:53.609459 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00868-9136-486f-9a37-2a94a13ab858 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:53.640023 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:53.706219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f1cfc-9634-4e0e-8257-a5b17ac1ff13 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:53.708408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00868-9136-486f-9a37-2a94a13ab858 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:53.716961 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:53.742042 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41226f-4311-45e7-aada-20c50027a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:53.742701 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41226f-4311-45e7-aada-20c50027a455 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:53.742936 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d8225-3567-42ed-afdd-07d6545e06b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:53.743037 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41226f-4311-45e7-aada-20c50027a455 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:53.743254 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41226f-4311-45e7-aada-20c50027a455 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:53.743536 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8225-3567-42ed-afdd-07d6545e06b9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:53.743818 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8225-3567-42ed-afdd-07d6545e06b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:53.744090 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d8225-3567-42ed-afdd-07d6545e06b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:53.744378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41226f-4311-45e7-aada-20c50027a455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:53.744807 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d8225-3567-42ed-afdd-07d6545e06b9 None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.domain.id=default, user.id=97d2196009fa44f294707c6fd6554a9d) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:10:53.745111 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d8225-3567-42ed-afdd-07d6545e06b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:53.745839 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41226f-4311-45e7-aada-20c50027a455 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:53.746570 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d8225-3567-42ed-afdd-07d6545e06b9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:53.747447 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:10:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:10:53.752649 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1322 bytes} [Tue Aug 23 07:10:53 2022] GET /identity/v3/role_assignments?user.id=97d2196009fa44f294707c6fd6554a9d&scope.domain.id=default&role.id=afe88bc03d30494b89892587177c79de => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:10:53.752914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41226f-4311-45e7-aada-20c50027a455 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:53.860147 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41226f-4311-45e7-aada-20c50027a455 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:53.895592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8f77f-26a8-46fe-b937-b41e8bdc3cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:53.896210 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8f77f-26a8-46fe-b937-b41e8bdc3cdc None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:53.896495 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8f77f-26a8-46fe-b937-b41e8bdc3cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:53.896774 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8f77f-26a8-46fe-b937-b41e8bdc3cdc None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:53.897993 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8f77f-26a8-46fe-b937-b41e8bdc3cdc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:53.899587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8f77f-26a8-46fe-b937-b41e8bdc3cdc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:53.991571 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Aug 23 07:10:53 2022] POST /identity/v3/projects => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:10:55.889631 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef44c-206b-4958-89a0-5b2007139776 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:55.890159 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef44c-206b-4958-89a0-5b2007139776 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:55.890248 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ef44c-206b-4958-89a0-5b2007139776 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:55.891561 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:10:55.896831 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151405-b2d5-49e3-8503-9f1ec2548305 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:55.897249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151405-b2d5-49e3-8503-9f1ec2548305 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:55.897702 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a151405-b2d5-49e3-8503-9f1ec2548305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:55.915440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1a151405-b2d5-49e3-8503-9f1ec2548305 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:55.916616 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1a151405-b2d5-49e3-8503-9f1ec2548305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:55.940093 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:55.982842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:10:56.253859 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ef44c-206b-4958-89a0-5b2007139776 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:56.346472 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:56.354509 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ef44c-206b-4958-89a0-5b2007139776 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:56.387428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ca8bf-7b2d-4c19-b6fe-865aabfc9209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:56.388046 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ca8bf-7b2d-4c19-b6fe-865aabfc9209 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:56.388327 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ca8bf-7b2d-4c19-b6fe-865aabfc9209 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:56.388599 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ca8bf-7b2d-4c19-b6fe-865aabfc9209 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:56.389674 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ca8bf-7b2d-4c19-b6fe-865aabfc9209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:56.391127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ca8bf-7b2d-4c19-b6fe-865aabfc9209 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:56.392655 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:10:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:10:56.398779 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151405-b2d5-49e3-8503-9f1ec2548305 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:56.495017 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a151405-b2d5-49e3-8503-9f1ec2548305 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:10:56.528000 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4154e5cf-19a3-4e65-bc95-4cf91fd00f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:10:56.528537 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154e5cf-19a3-4e65-bc95-4cf91fd00f46 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:56.528824 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154e5cf-19a3-4e65-bc95-4cf91fd00f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:56.529103 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4154e5cf-19a3-4e65-bc95-4cf91fd00f46 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:56.529756 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154e5cf-19a3-4e65-bc95-4cf91fd00f46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:10:56.531222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4154e5cf-19a3-4e65-bc95-4cf91fd00f46 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:10:56.601332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:10:56 2022] POST /identity/v3/users => generated 275 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:10:59.423892 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda629-1f84-4e42-8909-e2a2a6585be7 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:59.424797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda629-1f84-4e42-8909-e2a2a6585be7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:59.425246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda629-1f84-4e42-8909-e2a2a6585be7 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:59.426868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:10:59.439526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aeff8-6fe1-46c3-ba30-8a9e793c7ffd None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:59.440453 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aeff8-6fe1-46c3-ba30-8a9e793c7ffd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:59.440934 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8aeff8-6fe1-46c3-ba30-8a9e793c7ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:59.464320 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5b8aeff8-6fe1-46c3-ba30-8a9e793c7ffd None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:59.465807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5b8aeff8-6fe1-46c3-ba30-8a9e793c7ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:59.484348 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:10:59.562449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 32/63] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:10:59.627415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801345f-ee34-4f1e-a1d0-d0ee206c23c2 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:59.627724 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801345f-ee34-4f1e-a1d0-d0ee206c23c2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:59.628000 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801345f-ee34-4f1e-a1d0-d0ee206c23c2 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:59.629309 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 32/64] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:10:59.648757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa7ac-e941-45ef-b19c-254047be13bc None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:59.649073 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa7ac-e941-45ef-b19c-254047be13bc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:59.649313 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fa7ac-e941-45ef-b19c-254047be13bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:59.674166 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1e4fa7ac-e941-45ef-b19c-254047be13bc None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:59.675262 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1e4fa7ac-e941-45ef-b19c-254047be13bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:59.730220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ba251-f772-43e1-bfa3-1a5284a5da89 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:59.730520 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ba251-f772-43e1-bfa3-1a5284a5da89 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:59.730776 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ba251-f772-43e1-bfa3-1a5284a5da89 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:59.732108 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 33/65] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:10:59.737248 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6b8fe-c3e4-4240-a336-1cbf7c4f2467 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:10:59.737538 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6b8fe-c3e4-4240-a336-1cbf7c4f2467 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:10:59.737818 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6b8fe-c3e4-4240-a336-1cbf7c4f2467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:10:59.764300 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-59f6b8fe-c3e4-4240-a336-1cbf7c4f2467 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:10:59.765475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-59f6b8fe-c3e4-4240-a336-1cbf7c4f2467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:10:59.789206 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 33/66] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:10:59.868363 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:10:59.903038 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa7ac-e941-45ef-b19c-254047be13bc None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:10:59.998410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:00.030021 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fa7ac-e941-45ef-b19c-254047be13bc None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:00.081162 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7991f-a6e7-48bb-af38-a44437687d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:00.082065 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7991f-a6e7-48bb-af38-a44437687d6e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.082514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7991f-a6e7-48bb-af38-a44437687d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.082947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7991f-a6e7-48bb-af38-a44437687d6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.102958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7991f-a6e7-48bb-af38-a44437687d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8db7991f-a6e7-48bb-af38-a44437687d6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:00.109535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:00.110586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:00.111566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:00.113471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 34/68] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:10:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:00.119835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6b8fe-c3e4-4240-a336-1cbf7c4f2467 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:00.152409 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7991f-a6e7-48bb-af38-a44437687d6e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:00.249107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:00.259050 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6b8fe-c3e4-4240-a336-1cbf7c4f2467 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:00.266958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7991f-a6e7-48bb-af38-a44437687d6e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:00.299078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6e63-247c-4ab0-89b5-1a103c3ef848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:00.299694 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6e63-247c-4ab0-89b5-1a103c3ef848 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.299976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6e63-247c-4ab0-89b5-1a103c3ef848 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.300247 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e6e63-247c-4ab0-89b5-1a103c3ef848 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.300904 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e6e63-247c-4ab0-89b5-1a103c3ef848 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:00.301296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e6e63-247c-4ab0-89b5-1a103c3ef848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:00.302729 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e6e63-247c-4ab0-89b5-1a103c3ef848 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:00.304088 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af745afd-195b-4770-a6d5-bc84a378cebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:00.304725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af745afd-195b-4770-a6d5-bc84a378cebd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.305010 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af745afd-195b-4770-a6d5-bc84a378cebd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.305288 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af745afd-195b-4770-a6d5-bc84a378cebd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.308445 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:00.311835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:00.312649 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6e63-247c-4ab0-89b5-1a103c3ef848 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:00.322660 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af745afd-195b-4770-a6d5-bc84a378cebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-af745afd-195b-4770-a6d5-bc84a378cebd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:00.327772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:00.328580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:00.329350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:00.331290 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 35/70] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:00.332739 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b9479-8446-46f6-bdc0-7795d2b59cef None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.333005 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b9479-8446-46f6-bdc0-7795d2b59cef None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.333279 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b9479-8446-46f6-bdc0-7795d2b59cef None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.338775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 36/71] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:00.338775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b9479-8446-46f6-bdc0-7795d2b59cef None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:00.431223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e6e63-247c-4ab0-89b5-1a103c3ef848 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:00.450539 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b9479-8446-46f6-bdc0-7795d2b59cef None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:00.466197 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41d0e3-61a8-4598-93d5-3a1b99ee34d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:00.466834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d0e3-61a8-4598-93d5-3a1b99ee34d4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.467113 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d0e3-61a8-4598-93d5-3a1b99ee34d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.467385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d0e3-61a8-4598-93d5-3a1b99ee34d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.478353 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41d0e3-61a8-4598-93d5-3a1b99ee34d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0c41d0e3-61a8-4598-93d5-3a1b99ee34d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:00.484243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:00.485084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:00.485836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 36/72] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:11:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:00.486483 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41d0e3-61a8-4598-93d5-3a1b99ee34d4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:00.490074 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92496478-af97-480f-87f8-52746d129f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:00.491483 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92496478-af97-480f-87f8-52746d129f2b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.491763 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92496478-af97-480f-87f8-52746d129f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.492038 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92496478-af97-480f-87f8-52746d129f2b None admin] PATH_INFO: `/v3/users/2a4b92f4861847f4b9f3dab965f7351b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.505794 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:00.507854 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92496478-af97-480f-87f8-52746d129f2b None admin] RBAC: Authorizing `identity:get_user(user_id=2a4b92f4861847f4b9f3dab965f7351b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:00.509410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92496478-af97-480f-87f8-52746d129f2b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:00.511209 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:00 2022] GET /identity/v3/users/2a4b92f4861847f4b9f3dab965f7351b => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:00.512524 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e203e6-7886-4059-b9ad-a93fa37b1201 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.512809 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e203e6-7886-4059-b9ad-a93fa37b1201 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.513088 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e203e6-7886-4059-b9ad-a93fa37b1201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.531457 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e0e203e6-7886-4059-b9ad-a93fa37b1201 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:00.532689 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e0e203e6-7886-4059-b9ad-a93fa37b1201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:00.589725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:00.600181 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41d0e3-61a8-4598-93d5-3a1b99ee34d4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:00.610244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 38/74] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:00.611019 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e203e6-7886-4059-b9ad-a93fa37b1201 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:00.651566 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5743147-7078-44b9-a1f8-fe8fcd0e8d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:00.652548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5743147-7078-44b9-a1f8-fe8fcd0e8d5a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.653023 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5743147-7078-44b9-a1f8-fe8fcd0e8d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.653882 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5743147-7078-44b9-a1f8-fe8fcd0e8d5a None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.654780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5743147-7078-44b9-a1f8-fe8fcd0e8d5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:00.655656 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5743147-7078-44b9-a1f8-fe8fcd0e8d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:00.657707 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5743147-7078-44b9-a1f8-fe8fcd0e8d5a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:00.668609 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:00.669664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5743147-7078-44b9-a1f8-fe8fcd0e8d5a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:00.723786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e203e6-7886-4059-b9ad-a93fa37b1201 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:00.758090 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:00.760174 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ddd2b-7c8e-45bc-9e1f-0ce70f353fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:00.760824 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddd2b-7c8e-45bc-9e1f-0ce70f353fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.761088 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddd2b-7c8e-45bc-9e1f-0ce70f353fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.761323 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ddd2b-7c8e-45bc-9e1f-0ce70f353fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.761983 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ddd2b-7c8e-45bc-9e1f-0ce70f353fe1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:00.762315 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ddd2b-7c8e-45bc-9e1f-0ce70f353fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:00.763693 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ddd2b-7c8e-45bc-9e1f-0ce70f353fe1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:00.772387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:00.773211 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ddd2b-7c8e-45bc-9e1f-0ce70f353fe1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:00.783819 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5743147-7078-44b9-a1f8-fe8fcd0e8d5a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:00.822364 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:00.824621 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af425679-84a4-4259-8cf5-23fb83e0aef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:00.825480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af425679-84a4-4259-8cf5-23fb83e0aef1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.825901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af425679-84a4-4259-8cf5-23fb83e0aef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.826375 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af425679-84a4-4259-8cf5-23fb83e0aef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.881299 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ddd2b-7c8e-45bc-9e1f-0ce70f353fe1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:00.900092 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af425679-84a4-4259-8cf5-23fb83e0aef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:00.901559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af425679-84a4-4259-8cf5-23fb83e0aef1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:00.914934 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672972a-ac27-4db8-99d2-9f8cbcadd720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:00.915561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672972a-ac27-4db8-99d2-9f8cbcadd720 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.915841 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672972a-ac27-4db8-99d2-9f8cbcadd720 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.916114 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672972a-ac27-4db8-99d2-9f8cbcadd720 None admin] PATH_INFO: `/v3/users/2a4b92f4861847f4b9f3dab965f7351b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.917229 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672972a-ac27-4db8-99d2-9f8cbcadd720 None admin] RBAC: Authorizing `identity:get_user(user_id=2a4b92f4861847f4b9f3dab965f7351b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:00.918699 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672972a-ac27-4db8-99d2-9f8cbcadd720 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:00.920416 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 40/77] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:00 2022] GET /identity/v3/users/2a4b92f4861847f4b9f3dab965f7351b => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:00.921345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6e202-12e5-48c4-bba0-c72cebc6bd88 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:00.921626 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6e202-12e5-48c4-bba0-c72cebc6bd88 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:00.921902 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b6e202-12e5-48c4-bba0-c72cebc6bd88 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:00.923120 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 41/78] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:00.923854 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6e202-12e5-48c4-bba0-c72cebc6bd88 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:00.980809 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:01.003576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 38/79] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:01.004600 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af425679-84a4-4259-8cf5-23fb83e0aef1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:01.030525 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b6e202-12e5-48c4-bba0-c72cebc6bd88 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:01.045168 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:01.064658 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36492c90-f8a1-4f0c-9a88-e86300c13e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:01.065363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492c90-f8a1-4f0c-9a88-e86300c13e89 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:01.065641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492c90-f8a1-4f0c-9a88-e86300c13e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:01.065910 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36492c90-f8a1-4f0c-9a88-e86300c13e89 None admin] PATH_INFO: `/v3/users/97d2196009fa44f294707c6fd6554a9d` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:01.067040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36492c90-f8a1-4f0c-9a88-e86300c13e89 None admin] RBAC: Authorizing `identity:get_user(user_id=97d2196009fa44f294707c6fd6554a9d)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:01.068487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36492c90-f8a1-4f0c-9a88-e86300c13e89 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:01.070518 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 42/80] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:00 2022] GET /identity/v3/users/97d2196009fa44f294707c6fd6554a9d => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:01.071801 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36492c90-f8a1-4f0c-9a88-e86300c13e89 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:01.103877 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af425679-84a4-4259-8cf5-23fb83e0aef1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:01.137082 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6245c-ce37-446e-ac14-1e8e16d4f414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:01.137716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6245c-ce37-446e-ac14-1e8e16d4f414 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:01.137992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6245c-ce37-446e-ac14-1e8e16d4f414 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:01.138291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6245c-ce37-446e-ac14-1e8e16d4f414 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:01.148656 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6245c-ce37-446e-ac14-1e8e16d4f414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-dcf6245c-ce37-446e-ac14-1e8e16d4f414 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:01.153341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:01.154252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:01.155003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 39/81] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:01.155997 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43b52-0eb3-4e83-9560-69ac5a51995c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:01.156434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43b52-0eb3-4e83-9560-69ac5a51995c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:01.156556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e43b52-0eb3-4e83-9560-69ac5a51995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:01.173039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d3e43b52-0eb3-4e83-9560-69ac5a51995c None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:01.173731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36492c90-f8a1-4f0c-9a88-e86300c13e89 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:01.174250 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d3e43b52-0eb3-4e83-9560-69ac5a51995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:01.204053 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:01.208875 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a7df2-4202-4031-beac-b143f48a39c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:01.209614 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a7df2-4202-4031-beac-b143f48a39c6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:01.209899 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a7df2-4202-4031-beac-b143f48a39c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:01.210207 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a7df2-4202-4031-beac-b143f48a39c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:01.242727 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 40/82] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:01.243571 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e43b52-0eb3-4e83-9560-69ac5a51995c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:01.260793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:01.280912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a7df2-4202-4031-beac-b143f48a39c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:01.283463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a7df2-4202-4031-beac-b143f48a39c6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:01.357158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e43b52-0eb3-4e83-9560-69ac5a51995c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:01.395488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af2060-43e7-4f87-bfb2-3ff24c8be4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:01.396398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af2060-43e7-4f87-bfb2-3ff24c8be4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:01.396730 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af2060-43e7-4f87-bfb2-3ff24c8be4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:01.397085 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4af2060-43e7-4f87-bfb2-3ff24c8be4b1 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:01.398718 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af2060-43e7-4f87-bfb2-3ff24c8be4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:01.400494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4af2060-43e7-4f87-bfb2-3ff24c8be4b1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:01.401728 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 43/83] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:01.406934 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 41/84] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:01 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:01.407068 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a7df2-4202-4031-beac-b143f48a39c6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:01.407160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af2060-43e7-4f87-bfb2-3ff24c8be4b1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:01.445641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:01.486573 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:01.505427 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a7df2-4202-4031-beac-b143f48a39c6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:01.526551 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4af2060-43e7-4f87-bfb2-3ff24c8be4b1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:01.541948 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547450ef-a09f-4cdd-83a4-e67a8702c5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:01.542516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547450ef-a09f-4cdd-83a4-e67a8702c5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:01.542799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547450ef-a09f-4cdd-83a4-e67a8702c5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:01.543077 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547450ef-a09f-4cdd-83a4-e67a8702c5b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:01.561269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c34ea9-9e86-4a93-a2fb-48a0e52bafb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:01.561875 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c34ea9-9e86-4a93-a2fb-48a0e52bafb9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:01.562180 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c34ea9-9e86-4a93-a2fb-48a0e52bafb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:01.562457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c34ea9-9e86-4a93-a2fb-48a0e52bafb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:01.563118 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c34ea9-9e86-4a93-a2fb-48a0e52bafb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:01.563418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c34ea9-9e86-4a93-a2fb-48a0e52bafb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:01.564798 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c34ea9-9e86-4a93-a2fb-48a0e52bafb9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:01.572842 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 42/85] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:01.573618 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c34ea9-9e86-4a93-a2fb-48a0e52bafb9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:01.618089 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547450ef-a09f-4cdd-83a4-e67a8702c5b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:01.619589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547450ef-a09f-4cdd-83a4-e67a8702c5b6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:01.668956 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:01.674800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c34ea9-9e86-4a93-a2fb-48a0e52bafb9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:01.700656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:01.708396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c314aa-36ee-49ba-aac2-bc74e21059d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:01.709169 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c314aa-36ee-49ba-aac2-bc74e21059d1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:01.709852 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c314aa-36ee-49ba-aac2-bc74e21059d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:01.710167 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c314aa-36ee-49ba-aac2-bc74e21059d1 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:01.711712 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c314aa-36ee-49ba-aac2-bc74e21059d1 None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:01.713159 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c314aa-36ee-49ba-aac2-bc74e21059d1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:01.714808 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 43/86] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:01 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:01.722307 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c314aa-36ee-49ba-aac2-bc74e21059d1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:01.722424 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 44/87] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:01.722424 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547450ef-a09f-4cdd-83a4-e67a8702c5b6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:01.813084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c314aa-36ee-49ba-aac2-bc74e21059d1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:01.818949 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547450ef-a09f-4cdd-83a4-e67a8702c5b6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:01.846818 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d004-1b59-4462-baa4-96e81daf3b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:01.847422 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d004-1b59-4462-baa4-96e81daf3b5b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:01.847710 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d004-1b59-4462-baa4-96e81daf3b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:01.847988 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317d004-1b59-4462-baa4-96e81daf3b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:01.848713 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317d004-1b59-4462-baa4-96e81daf3b5b None admin] RBAC: Adding query filter params (role.id=550a417973df4feda528c3e0787c1619, scope.project.id=3d0a846940634bc59ecf00e3124e353c, user.id=2a4b92f4861847f4b9f3dab965f7351b) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:01.849022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317d004-1b59-4462-baa4-96e81daf3b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:01.850542 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317d004-1b59-4462-baa4-96e81daf3b5b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:01.851817 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafa2ab-3296-403f-8d01-750ddf3f10cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:01.852443 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafa2ab-3296-403f-8d01-750ddf3f10cb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:01.852726 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafa2ab-3296-403f-8d01-750ddf3f10cb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:01.852996 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafa2ab-3296-403f-8d01-750ddf3f10cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:01.854095 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafa2ab-3296-403f-8d01-750ddf3f10cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:01.855535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafa2ab-3296-403f-8d01-750ddf3f10cb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:01.855872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 44/88] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:01 2022] GET /identity/v3/role_assignments?user.id=2a4b92f4861847f4b9f3dab965f7351b&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=550a417973df4feda528c3e0787c1619 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:01.856680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d004-1b59-4462-baa4-96e81daf3b5b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:01.857092 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 45/89] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:01.857844 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafa2ab-3296-403f-8d01-750ddf3f10cb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:01.890436 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:01.925027 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:01.970590 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317d004-1b59-4462-baa4-96e81daf3b5b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:01.984135 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafa2ab-3296-403f-8d01-750ddf3f10cb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:02.010850 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c139-dce9-47de-a232-7b7d79bcc848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:02.011501 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c139-dce9-47de-a232-7b7d79bcc848 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:02.011787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c139-dce9-47de-a232-7b7d79bcc848 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:02.022176 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7c139-dce9-47de-a232-7b7d79bcc848 None admin] PATH_INFO: `/v3/users/2a4b92f4861847f4b9f3dab965f7351b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:02.022176 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7c139-dce9-47de-a232-7b7d79bcc848 None admin] RBAC: Authorizing `identity:get_user(user_id=2a4b92f4861847f4b9f3dab965f7351b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:02.022176 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7c139-dce9-47de-a232-7b7d79bcc848 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:02.022176 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 45/90] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:01 2022] GET /identity/v3/users/2a4b92f4861847f4b9f3dab965f7351b => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:02.022176 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c139-dce9-47de-a232-7b7d79bcc848 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:02.027081 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2df67a-4e22-4d4a-bfe6-7e6425ac8eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:02.027692 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2df67a-4e22-4d4a-bfe6-7e6425ac8eec None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:02.028186 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2df67a-4e22-4d4a-bfe6-7e6425ac8eec None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:02.028356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2df67a-4e22-4d4a-bfe6-7e6425ac8eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:02.029075 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2df67a-4e22-4d4a-bfe6-7e6425ac8eec None admin] RBAC: Adding query filter params (role.id=adc491d8d49c47779e572883af3ed47e, scope.project.id=3d0a846940634bc59ecf00e3124e353c, user.id=2a4b92f4861847f4b9f3dab965f7351b) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:02.029526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2df67a-4e22-4d4a-bfe6-7e6425ac8eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:02.030948 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2df67a-4e22-4d4a-bfe6-7e6425ac8eec None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:02.050139 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 46/91] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:01 2022] GET /identity/v3/role_assignments?user.id=2a4b92f4861847f4b9f3dab965f7351b&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=adc491d8d49c47779e572883af3ed47e => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:02.050139 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2df67a-4e22-4d4a-bfe6-7e6425ac8eec None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:02.152909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:02.159243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7c139-dce9-47de-a232-7b7d79bcc848 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:02.172607 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2df67a-4e22-4d4a-bfe6-7e6425ac8eec None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:02.195200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:02.209850 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a25656-3df8-42b9-9164-3fe9c954feb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:02.210903 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a25656-3df8-42b9-9164-3fe9c954feb9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:02.211592 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a25656-3df8-42b9-9164-3fe9c954feb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:02.212183 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a25656-3df8-42b9-9164-3fe9c954feb9 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:02.213981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a25656-3df8-42b9-9164-3fe9c954feb9 None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:02.215890 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a25656-3df8-42b9-9164-3fe9c954feb9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:02.217716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 46/92] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:02 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:02.218682 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a25656-3df8-42b9-9164-3fe9c954feb9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:02.220007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3141ff0-d5ed-4964-ba46-b1d7d292b7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:02.220622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141ff0-d5ed-4964-ba46-b1d7d292b7a7 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:02.220910 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141ff0-d5ed-4964-ba46-b1d7d292b7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:02.221196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141ff0-d5ed-4964-ba46-b1d7d292b7a7 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:02.221851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3141ff0-d5ed-4964-ba46-b1d7d292b7a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:02.224162 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3141ff0-d5ed-4964-ba46-b1d7d292b7a7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:02.326192 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 47/93] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:11:02 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:02.326192 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3141ff0-d5ed-4964-ba46-b1d7d292b7a7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:02.349326 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a25656-3df8-42b9-9164-3fe9c954feb9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:02.419647 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e493fb-ec36-4b6f-9f37-b0e8a9d7b898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:02.420492 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e493fb-ec36-4b6f-9f37-b0e8a9d7b898 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:02.420933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e493fb-ec36-4b6f-9f37-b0e8a9d7b898 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:02.421361 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e493fb-ec36-4b6f-9f37-b0e8a9d7b898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:02.453828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3141ff0-d5ed-4964-ba46-b1d7d292b7a7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:02.507756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:02.513276 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd5a76-8dbb-4e3d-b71a-4ae3d4cc0ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:02.513968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5a76-8dbb-4e3d-b71a-4ae3d4cc0ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:02.514296 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5a76-8dbb-4e3d-b71a-4ae3d4cc0ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:02.514578 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd5a76-8dbb-4e3d-b71a-4ae3d4cc0ad9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:02.515493 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd5a76-8dbb-4e3d-b71a-4ae3d4cc0ad9 None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=3d0a846940634bc59ecf00e3124e353c, user.id=97d2196009fa44f294707c6fd6554a9d) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:02.515846 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd5a76-8dbb-4e3d-b71a-4ae3d4cc0ad9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:02.523306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd5a76-8dbb-4e3d-b71a-4ae3d4cc0ad9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:02.525821 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 48/94] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:02 2022] GET /identity/v3/role_assignments?user.id=97d2196009fa44f294707c6fd6554a9d&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=afe88bc03d30494b89892587177c79de => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:02.570974 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e493fb-ec36-4b6f-9f37-b0e8a9d7b898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:02.572528 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e493fb-ec36-4b6f-9f37-b0e8a9d7b898 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:02.690007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 47/95] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:02.696366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd5a76-8dbb-4e3d-b71a-4ae3d4cc0ad9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:02.739132 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:02.809235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd5a76-8dbb-4e3d-b71a-4ae3d4cc0ad9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:02.844814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369c3e44-d154-440a-a12f-c5d1a9f1474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:02.845452 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c3e44-d154-440a-a12f-c5d1a9f1474d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:02.845733 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c3e44-d154-440a-a12f-c5d1a9f1474d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:02.846007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c3e44-d154-440a-a12f-c5d1a9f1474d None admin] PATH_INFO: `/v3/projects/4d70b5c4b8974d0490b2b4d20326fa42` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:02.847191 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c3e44-d154-440a-a12f-c5d1a9f1474d None admin] RBAC: Authorizing `identity:get_project(project_id=4d70b5c4b8974d0490b2b4d20326fa42)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:02.848650 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369c3e44-d154-440a-a12f-c5d1a9f1474d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:02.851195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:02 2022] GET /identity/v3/projects/4d70b5c4b8974d0490b2b4d20326fa42 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:02.856906 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e493fb-ec36-4b6f-9f37-b0e8a9d7b898 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:02.923529 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:02.964097 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e493fb-ec36-4b6f-9f37-b0e8a9d7b898 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:03.001960 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c34e8-8f12-4aeb-9298-af6264b78a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:03.002607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c34e8-8f12-4aeb-9298-af6264b78a3e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:03.002890 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c34e8-8f12-4aeb-9298-af6264b78a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:03.003167 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c34e8-8f12-4aeb-9298-af6264b78a3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:03.003896 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c34e8-8f12-4aeb-9298-af6264b78a3e None admin] RBAC: Adding query filter params (role.id=550a417973df4feda528c3e0787c1619, scope.project.id=4d70b5c4b8974d0490b2b4d20326fa42, user.id=2a4b92f4861847f4b9f3dab965f7351b) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:03.004205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c34e8-8f12-4aeb-9298-af6264b78a3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:03.005656 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c34e8-8f12-4aeb-9298-af6264b78a3e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:03.011703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 48/97] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:02 2022] GET /identity/v3/role_assignments?user.id=2a4b92f4861847f4b9f3dab965f7351b&scope.project.id=4d70b5c4b8974d0490b2b4d20326fa42&role.id=550a417973df4feda528c3e0787c1619 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:03.915546 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d8bfc-69c6-4c4e-a1d1-b2590aa57f01 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:03.916080 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d8bfc-69c6-4c4e-a1d1-b2590aa57f01 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:03.916080 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d8bfc-69c6-4c4e-a1d1-b2590aa57f01 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:03.917456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 50/98] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:03.922955 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9123-0429-4c25-be3f-c1862c350674 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:03.923414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9123-0429-4c25-be3f-c1862c350674 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:03.923594 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9123-0429-4c25-be3f-c1862c350674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:03.987461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-b1ad9123-0429-4c25-be3f-c1862c350674 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:03.988662 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-b1ad9123-0429-4c25-be3f-c1862c350674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:04.069887 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 49/99] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:04.153669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c088a-b763-47fe-9e89-48f5ac2f6c09 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:04.153979 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c088a-b763-47fe-9e89-48f5ac2f6c09 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:04.154272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c088a-b763-47fe-9e89-48f5ac2f6c09 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:04.155635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 51/100] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:04.161001 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b52da-1b88-49a9-a94e-33159c4e50e2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:04.161297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b52da-1b88-49a9-a94e-33159c4e50e2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:04.161579 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b52da-1b88-49a9-a94e-33159c4e50e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:04.187199 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-120b52da-1b88-49a9-a94e-33159c4e50e2 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:04.188316 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-120b52da-1b88-49a9-a94e-33159c4e50e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:04.252678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:04.270355 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 50/101] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:04.579717 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c088a-b763-47fe-9e89-48f5ac2f6c09 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:04.694549 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c088a-b763-47fe-9e89-48f5ac2f6c09 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:04.696221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:04.739161 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddff8f7-2a99-4789-9fcb-d7f2fb19b773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:04.739797 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff8f7-2a99-4789-9fcb-d7f2fb19b773 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:04.740117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff8f7-2a99-4789-9fcb-d7f2fb19b773 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:04.740437 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff8f7-2a99-4789-9fcb-d7f2fb19b773 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:04.756628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddff8f7-2a99-4789-9fcb-d7f2fb19b773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7ddff8f7-2a99-4789-9fcb-d7f2fb19b773 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:04.762136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:04.763044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:04.763767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 52/102] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:04.770368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b52da-1b88-49a9-a94e-33159c4e50e2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:04.784667 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddff8f7-2a99-4789-9fcb-d7f2fb19b773 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:04.954407 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddff8f7-2a99-4789-9fcb-d7f2fb19b773 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:04.956040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b52da-1b88-49a9-a94e-33159c4e50e2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:05.027358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29904f0c-67c3-4223-b4c1-37c3e8438867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:05.028270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29904f0c-67c3-4223-b4c1-37c3e8438867 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.028696 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29904f0c-67c3-4223-b4c1-37c3e8438867 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.029112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29904f0c-67c3-4223-b4c1-37c3e8438867 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.030826 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9208-8713-4b08-ba6c-7520867eb8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:05.031463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9208-8713-4b08-ba6c-7520867eb8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.031750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9208-8713-4b08-ba6c-7520867eb8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.032028 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc9208-8713-4b08-ba6c-7520867eb8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.032711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc9208-8713-4b08-ba6c-7520867eb8c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:05.033025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc9208-8713-4b08-ba6c-7520867eb8c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:05.034658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc9208-8713-4b08-ba6c-7520867eb8c0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:05.046416 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29904f0c-67c3-4223-b4c1-37c3e8438867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:05.058444 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 51/103] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-29904f0c-67c3-4223-b4c1-37c3e8438867 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:05.059181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:05.060231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:05.061012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:05.063267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 53/104] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:05.063846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9208-8713-4b08-ba6c-7520867eb8c0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:05.069436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29904f0c-67c3-4223-b4c1-37c3e8438867 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:05.108438 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:05.158485 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:05.204189 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc9208-8713-4b08-ba6c-7520867eb8c0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:05.242807 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3aaaa5-9461-4b63-947b-195ef1bdb868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:05.243366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aaaa5-9461-4b63-947b-195ef1bdb868 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.243652 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aaaa5-9461-4b63-947b-195ef1bdb868 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.243927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3aaaa5-9461-4b63-947b-195ef1bdb868 None admin] PATH_INFO: `/v3/users/2a4b92f4861847f4b9f3dab965f7351b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.244447 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29904f0c-67c3-4223-b4c1-37c3e8438867 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:05.245216 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3aaaa5-9461-4b63-947b-195ef1bdb868 None admin] RBAC: Authorizing `identity:get_user(user_id=2a4b92f4861847f4b9f3dab965f7351b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:05.247017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3aaaa5-9461-4b63-947b-195ef1bdb868 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:05.249040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 52/105] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:05 2022] GET /identity/v3/users/2a4b92f4861847f4b9f3dab965f7351b => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:05.255438 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a85a0-da81-4160-bb7a-fb096c9dd90d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.256995 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a85a0-da81-4160-bb7a-fb096c9dd90d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.257426 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a85a0-da81-4160-bb7a-fb096c9dd90d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.258969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 53/106] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:05.259837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a85a0-da81-4160-bb7a-fb096c9dd90d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:05.324433 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe87e16-4657-4a1c-9f38-d12c5ba70a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:05.325285 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe87e16-4657-4a1c-9f38-d12c5ba70a9f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.325710 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe87e16-4657-4a1c-9f38-d12c5ba70a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.326172 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe87e16-4657-4a1c-9f38-d12c5ba70a9f None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.326983 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe87e16-4657-4a1c-9f38-d12c5ba70a9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:05.327431 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe87e16-4657-4a1c-9f38-d12c5ba70a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:05.328960 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe87e16-4657-4a1c-9f38-d12c5ba70a9f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:05.346673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 54/107] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:05.352202 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334c213-84c2-4100-af7a-4d4cf112af1d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.352655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334c213-84c2-4100-af7a-4d4cf112af1d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.353092 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334c213-84c2-4100-af7a-4d4cf112af1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.390735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4334c213-84c2-4100-af7a-4d4cf112af1d None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:05.392179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4334c213-84c2-4100-af7a-4d4cf112af1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:05.472328 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 55/108] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:05.473569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334c213-84c2-4100-af7a-4d4cf112af1d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:05.485185 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a85a0-da81-4160-bb7a-fb096c9dd90d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:05.492299 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:05.550222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:05.571701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aca2b-1a1a-4dc8-b85f-5791cbc48dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:05.578374 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aca2b-1a1a-4dc8-b85f-5791cbc48dfd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.578374 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aca2b-1a1a-4dc8-b85f-5791cbc48dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.578374 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aca2b-1a1a-4dc8-b85f-5791cbc48dfd None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.578892 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353aca2b-1a1a-4dc8-b85f-5791cbc48dfd None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:05.585409 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353aca2b-1a1a-4dc8-b85f-5791cbc48dfd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:05.597108 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 54/109] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:05 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:05.602591 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aca2b-1a1a-4dc8-b85f-5791cbc48dfd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:05.620343 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334c213-84c2-4100-af7a-4d4cf112af1d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:05.675694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408c5ad-285d-48ab-a95b-e094a3f30194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:05.676344 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c5ad-285d-48ab-a95b-e094a3f30194 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.676630 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c5ad-285d-48ab-a95b-e094a3f30194 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.676906 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c5ad-285d-48ab-a95b-e094a3f30194 None admin] PATH_INFO: `/v3/users/2a4b92f4861847f4b9f3dab965f7351b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.679999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408c5ad-285d-48ab-a95b-e094a3f30194 None admin] RBAC: Authorizing `identity:get_user(user_id=2a4b92f4861847f4b9f3dab965f7351b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:05.681459 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408c5ad-285d-48ab-a95b-e094a3f30194 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:05.683112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 56/110] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:05 2022] GET /identity/v3/users/2a4b92f4861847f4b9f3dab965f7351b => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:05.684254 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa4a1a-bb66-4425-84a3-5d1a28760446 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.684544 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa4a1a-bb66-4425-84a3-5d1a28760446 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.684823 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa4a1a-bb66-4425-84a3-5d1a28760446 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.686029 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 57/111] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:05.694724 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa4a1a-bb66-4425-84a3-5d1a28760446 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:05.793883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aca2b-1a1a-4dc8-b85f-5791cbc48dfd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:05.832344 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c72cb0-1a71-4e70-9ddb-0117751ec9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:05.833327 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72cb0-1a71-4e70-9ddb-0117751ec9fa None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.834952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72cb0-1a71-4e70-9ddb-0117751ec9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.835452 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c72cb0-1a71-4e70-9ddb-0117751ec9fa None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c/users/2a4b92f4861847f4b9f3dab965f7351b/roles/550a417973df4feda528c3e0787c1619` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.838165 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c72cb0-1a71-4e70-9ddb-0117751ec9fa None admin] RBAC: Authorizing `identity:create_grant(project_id=3d0a846940634bc59ecf00e3124e353c, user_id=2a4b92f4861847f4b9f3dab965f7351b, role_id=550a417973df4feda528c3e0787c1619)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:05.839719 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:05.841567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c72cb0-1a71-4e70-9ddb-0117751ec9fa None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:05.870518 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa4a1a-bb66-4425-84a3-5d1a28760446 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:05.909221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fae06-f735-4f34-bc55-4a86f000c1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:05.910269 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fae06-f735-4f34-bc55-4a86f000c1ce None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.910759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fae06-f735-4f34-bc55-4a86f000c1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.911275 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fae06-f735-4f34-bc55-4a86f000c1ce None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.912833 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fae06-f735-4f34-bc55-4a86f000c1ce None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:05.914710 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fae06-f735-4f34-bc55-4a86f000c1ce None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:05.916606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 58/112] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:05 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:05.917895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323cd83-e426-42f4-9ac5-05e57bb1cdfe None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:05.918397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323cd83-e426-42f4-9ac5-05e57bb1cdfe None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:05.918900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323cd83-e426-42f4-9ac5-05e57bb1cdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:05.932752 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 55/113] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:11:05 2022] PUT /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c/users/2a4b92f4861847f4b9f3dab965f7351b/roles/550a417973df4feda528c3e0787c1619 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 07:11:05.933939 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c72cb0-1a71-4e70-9ddb-0117751ec9fa None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:05.947043 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b323cd83-e426-42f4-9ac5-05e57bb1cdfe None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:05.948280 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b323cd83-e426-42f4-9ac5-05e57bb1cdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:06.002504 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:06.073781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c72cb0-1a71-4e70-9ddb-0117751ec9fa None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:06.102839 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 59/114] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:06.104527 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323cd83-e426-42f4-9ac5-05e57bb1cdfe None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:06.118847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5c5c-f7f2-41f3-9559-99079bc30f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:06.120298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5c5c-f7f2-41f3-9559-99079bc30f48 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:06.120800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5c5c-f7f2-41f3-9559-99079bc30f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:06.121265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5c5c-f7f2-41f3-9559-99079bc30f48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:06.135867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f5c5c-f7f2-41f3-9559-99079bc30f48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-599f5c5c-f7f2-41f3-9559-99079bc30f48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:06.140932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:06.141775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:06.142868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 56/115] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:06.143525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ac0fe-88a5-4a37-80a4-150a198c2fa9 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:06.143590 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ac0fe-88a5-4a37-80a4-150a198c2fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:06.144234 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ac0fe-88a5-4a37-80a4-150a198c2fa9 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:06.145217 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 57/116] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:06.150151 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ac0fe-88a5-4a37-80a4-150a198c2fa9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:06.236987 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:06.258120 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323cd83-e426-42f4-9ac5-05e57bb1cdfe None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:06.261133 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ac0fe-88a5-4a37-80a4-150a198c2fa9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:06.294030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09027a-6c8d-46e6-b448-4f9f0d5874ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:06.294733 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09027a-6c8d-46e6-b448-4f9f0d5874ac None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:06.295023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09027a-6c8d-46e6-b448-4f9f0d5874ac None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:06.295307 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09027a-6c8d-46e6-b448-4f9f0d5874ac None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c/users/2a4b92f4861847f4b9f3dab965f7351b/roles/adc491d8d49c47779e572883af3ed47e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:06.295539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc50e4e3-a483-4e99-9221-f6153d79ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:06.296266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e4e3-a483-4e99-9221-f6153d79ca8c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:06.296652 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e4e3-a483-4e99-9221-f6153d79ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:06.297013 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc50e4e3-a483-4e99-9221-f6153d79ca8c None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:06.297664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09027a-6c8d-46e6-b448-4f9f0d5874ac None admin] RBAC: Authorizing `identity:create_grant(project_id=3d0a846940634bc59ecf00e3124e353c, user_id=2a4b92f4861847f4b9f3dab965f7351b, role_id=adc491d8d49c47779e572883af3ed47e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:06.297766 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50e4e3-a483-4e99-9221-f6153d79ca8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:06.297979 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50e4e3-a483-4e99-9221-f6153d79ca8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:06.299173 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09027a-6c8d-46e6-b448-4f9f0d5874ac None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:06.299396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc50e4e3-a483-4e99-9221-f6153d79ca8c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:06.309352 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 58/117] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:06.311634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f91752-a814-4148-9ccd-a2cfd65ffcb7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:06.312148 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f91752-a814-4148-9ccd-a2cfd65ffcb7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:06.312603 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f91752-a814-4148-9ccd-a2cfd65ffcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:06.316263 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:06.332480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c3f91752-a814-4148-9ccd-a2cfd65ffcb7 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:06.333728 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c3f91752-a814-4148-9ccd-a2cfd65ffcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:06.394548 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 60/118] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:11:06 2022] PUT /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c/users/2a4b92f4861847f4b9f3dab965f7351b/roles/adc491d8d49c47779e572883af3ed47e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:06.394548 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1164f6-0883-4bd0-b766-9553a09e3dc8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:06.394548 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1164f6-0883-4bd0-b766-9553a09e3dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:06.394548 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1164f6-0883-4bd0-b766-9553a09e3dc8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:06.394548 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 61/119] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:06.394548 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1164f6-0883-4bd0-b766-9553a09e3dc8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:06.421617 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 59/120] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:06.422671 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f91752-a814-4148-9ccd-a2cfd65ffcb7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:06.608294 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1164f6-0883-4bd0-b766-9553a09e3dc8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:06.615634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:06.622564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f91752-a814-4148-9ccd-a2cfd65ffcb7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:06.656929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953cb32-cc77-4a7a-806f-c878314a01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:06.657960 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953cb32-cc77-4a7a-806f-c878314a01c5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:06.658502 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953cb32-cc77-4a7a-806f-c878314a01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:06.658919 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953cb32-cc77-4a7a-806f-c878314a01c5 None admin] PATH_INFO: `/v3/users/97d2196009fa44f294707c6fd6554a9d` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:06.660260 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953cb32-cc77-4a7a-806f-c878314a01c5 None admin] RBAC: Authorizing `identity:get_user(user_id=97d2196009fa44f294707c6fd6554a9d)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:06.661189 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc8c4c-e587-44e1-8e50-9f9e5541f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:06.662017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc8c4c-e587-44e1-8e50-9f9e5541f443 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:06.662556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc8c4c-e587-44e1-8e50-9f9e5541f443 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:06.662816 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9953cb32-cc77-4a7a-806f-c878314a01c5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:06.662995 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc8c4c-e587-44e1-8e50-9f9e5541f443 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:06.665055 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 62/121] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:06 2022] GET /identity/v3/users/97d2196009fa44f294707c6fd6554a9d => generated 247 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:06.671300 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eaaee-c883-40fb-b648-8f87536f4fff None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:06.671746 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eaaee-c883-40fb-b648-8f87536f4fff None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:06.672161 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eaaee-c883-40fb-b648-8f87536f4fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:06.679187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc8c4c-e587-44e1-8e50-9f9e5541f443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-58fc8c4c-e587-44e1-8e50-9f9e5541f443 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:06.684408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:06.685417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:06.686195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:06.687065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 60/122] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:06.697165 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc8c4c-e587-44e1-8e50-9f9e5541f443 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:06.697324 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ba3eaaee-c883-40fb-b648-8f87536f4fff None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:06.698755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ba3eaaee-c883-40fb-b648-8f87536f4fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:06.701079 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:06.785635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 63/123] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:06.790506 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eaaee-c883-40fb-b648-8f87536f4fff None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:06.880712 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc8c4c-e587-44e1-8e50-9f9e5541f443 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:06.926205 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eaaee-c883-40fb-b648-8f87536f4fff None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:06.937193 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c64ab-eed9-48eb-a7b3-18d12d74ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:06.937964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c64ab-eed9-48eb-a7b3-18d12d74ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:06.938389 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c64ab-eed9-48eb-a7b3-18d12d74ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:06.938725 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c64ab-eed9-48eb-a7b3-18d12d74ebc1 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:06.939873 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c64ab-eed9-48eb-a7b3-18d12d74ebc1 None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:06.944533 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c64ab-eed9-48eb-a7b3-18d12d74ebc1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:06.944533 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 61/124] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:06 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:06.944533 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c64ab-eed9-48eb-a7b3-18d12d74ebc1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:06.973649 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:07.028497 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c85ec-9050-464b-842e-3499e5bd2386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:07.029117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c85ec-9050-464b-842e-3499e5bd2386 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:07.029397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c85ec-9050-464b-842e-3499e5bd2386 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:07.029669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c85ec-9050-464b-842e-3499e5bd2386 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:07.030376 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c85ec-9050-464b-842e-3499e5bd2386 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:07.030676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c85ec-9050-464b-842e-3499e5bd2386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:07.032071 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c85ec-9050-464b-842e-3499e5bd2386 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:07.045781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:07.061859 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 64/125] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:07.062848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c85ec-9050-464b-842e-3499e5bd2386 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:07.116477 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c64ab-eed9-48eb-a7b3-18d12d74ebc1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:07.161067 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25807308-3cad-44fa-bf92-6455c84ec400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:07.162485 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25807308-3cad-44fa-bf92-6455c84ec400 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:07.162937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25807308-3cad-44fa-bf92-6455c84ec400 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:07.163417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25807308-3cad-44fa-bf92-6455c84ec400 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:07.178414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25807308-3cad-44fa-bf92-6455c84ec400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-25807308-3cad-44fa-bf92-6455c84ec400 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:07.186025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:07.187160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:07.188177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:07.188742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 62/126] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:07.189470 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25807308-3cad-44fa-bf92-6455c84ec400 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:07.231068 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c85ec-9050-464b-842e-3499e5bd2386 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:07.266317 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d50ca-0167-4248-bab2-726f9cbcfc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:07.266994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d50ca-0167-4248-bab2-726f9cbcfc42 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:07.267591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d50ca-0167-4248-bab2-726f9cbcfc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:07.267591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d50ca-0167-4248-bab2-726f9cbcfc42 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c/users/97d2196009fa44f294707c6fd6554a9d/roles/afe88bc03d30494b89892587177c79de` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:07.269495 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d50ca-0167-4248-bab2-726f9cbcfc42 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d0a846940634bc59ecf00e3124e353c, user_id=97d2196009fa44f294707c6fd6554a9d, role_id=afe88bc03d30494b89892587177c79de)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:07.271016 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d50ca-0167-4248-bab2-726f9cbcfc42 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:07.287847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:07.302988 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25807308-3cad-44fa-bf92-6455c84ec400 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:07.336224 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e4e9b-57bf-4e88-a4c1-24dd585d0c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:07.336828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e4e9b-57bf-4e88-a4c1-24dd585d0c27 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:07.337119 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e4e9b-57bf-4e88-a4c1-24dd585d0c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:07.337395 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e4e9b-57bf-4e88-a4c1-24dd585d0c27 None admin] PATH_INFO: `/v3/users/2a4b92f4861847f4b9f3dab965f7351b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:07.338558 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e4e9b-57bf-4e88-a4c1-24dd585d0c27 None admin] RBAC: Authorizing `identity:get_user(user_id=2a4b92f4861847f4b9f3dab965f7351b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:07.340028 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e4e9b-57bf-4e88-a4c1-24dd585d0c27 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:07.340687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 65/127] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:11:07 2022] PUT /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c/users/97d2196009fa44f294707c6fd6554a9d/roles/afe88bc03d30494b89892587177c79de => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:07.341794 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d50ca-0167-4248-bab2-726f9cbcfc42 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:07.356192 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 63/128] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:07 2022] GET /identity/v3/users/2a4b92f4861847f4b9f3dab965f7351b => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:07.357491 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e4e9b-57bf-4e88-a4c1-24dd585d0c27 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:07.479644 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e4e9b-57bf-4e88-a4c1-24dd585d0c27 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:07.518353 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5eeb6-9734-4075-ad0e-cc9a5798068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:07.518983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5eeb6-9734-4075-ad0e-cc9a5798068f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:07.519271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5eeb6-9734-4075-ad0e-cc9a5798068f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:07.519548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5eeb6-9734-4075-ad0e-cc9a5798068f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:07.520299 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5eeb6-9734-4075-ad0e-cc9a5798068f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:07.520580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:07.520680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5eeb6-9734-4075-ad0e-cc9a5798068f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:07.522866 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5eeb6-9734-4075-ad0e-cc9a5798068f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:07.532168 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 64/129] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:07.532869 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5eeb6-9734-4075-ad0e-cc9a5798068f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:07.553880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:07.607854 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d50ca-0167-4248-bab2-726f9cbcfc42 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:07.653981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5eeb6-9734-4075-ad0e-cc9a5798068f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:07.658818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c0cd5-b1b9-4679-aed0-5c2c88695fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:07.659471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c0cd5-b1b9-4679-aed0-5c2c88695fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:07.659755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c0cd5-b1b9-4679-aed0-5c2c88695fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:07.660030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c0cd5-b1b9-4679-aed0-5c2c88695fc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:07.661156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c0cd5-b1b9-4679-aed0-5c2c88695fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:07.663855 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c0cd5-b1b9-4679-aed0-5c2c88695fc6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:07.666014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 66/130] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:07.671727 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c0cd5-b1b9-4679-aed0-5c2c88695fc6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:07.696609 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741088-4a07-46cb-96b6-b3d712b11578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:07.697263 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741088-4a07-46cb-96b6-b3d712b11578 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:07.697548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741088-4a07-46cb-96b6-b3d712b11578 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:07.697825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a741088-4a07-46cb-96b6-b3d712b11578 None admin] PATH_INFO: `/v3/projects/4d70b5c4b8974d0490b2b4d20326fa42` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:07.699080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a741088-4a07-46cb-96b6-b3d712b11578 None admin] RBAC: Authorizing `identity:get_project(project_id=4d70b5c4b8974d0490b2b4d20326fa42)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:07.700563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a741088-4a07-46cb-96b6-b3d712b11578 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:07.702554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 65/131] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:07 2022] GET /identity/v3/projects/4d70b5c4b8974d0490b2b4d20326fa42 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:07.703166 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741088-4a07-46cb-96b6-b3d712b11578 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:07.799955 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c0cd5-b1b9-4679-aed0-5c2c88695fc6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:07.814120 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:07.843304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a741088-4a07-46cb-96b6-b3d712b11578 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:07.858153 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:07.873154 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5bdba-a4c1-4738-9657-1125ad791521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:07.874075 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5bdba-a4c1-4738-9657-1125ad791521 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:07.874623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5bdba-a4c1-4738-9657-1125ad791521 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:07.875151 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5bdba-a4c1-4738-9657-1125ad791521 None admin] PATH_INFO: `/v3/users/d7dda5eabf1a4261bc62300812461389` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:07.897872 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5bdba-a4c1-4738-9657-1125ad791521 None admin] RBAC: Authorizing `identity:get_user(user_id=d7dda5eabf1a4261bc62300812461389)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:07.899698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5bdba-a4c1-4738-9657-1125ad791521 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:07.904593 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 67/132] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:07 2022] GET /identity/v3/users/d7dda5eabf1a4261bc62300812461389 => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:07.906941 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5bdba-a4c1-4738-9657-1125ad791521 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:07.911003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026141-df92-42d6-8eb1-d67d773e561d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:07.913150 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026141-df92-42d6-8eb1-d67d773e561d None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:07.913781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026141-df92-42d6-8eb1-d67d773e561d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:07.914335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026141-df92-42d6-8eb1-d67d773e561d None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:07.915836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026141-df92-42d6-8eb1-d67d773e561d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:07.918640 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026141-df92-42d6-8eb1-d67d773e561d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:08.042882 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 66/133] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:11:07 2022] POST /identity/v3/projects => generated 302 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:08.051624 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026141-df92-42d6-8eb1-d67d773e561d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:08.068531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5bdba-a4c1-4738-9657-1125ad791521 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:08.133132 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa13ffe-662c-419c-b7bc-040d7ede93ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:08.134582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa13ffe-662c-419c-b7bc-040d7ede93ae None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:08.135865 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa13ffe-662c-419c-b7bc-040d7ede93ae None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:08.136371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa13ffe-662c-419c-b7bc-040d7ede93ae None admin] PATH_INFO: `/v3/projects/4d70b5c4b8974d0490b2b4d20326fa42/users/2a4b92f4861847f4b9f3dab965f7351b/roles/550a417973df4feda528c3e0787c1619` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:08.140809 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa13ffe-662c-419c-b7bc-040d7ede93ae None admin] RBAC: Authorizing `identity:create_grant(project_id=4d70b5c4b8974d0490b2b4d20326fa42, user_id=2a4b92f4861847f4b9f3dab965f7351b, role_id=550a417973df4feda528c3e0787c1619)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:08.146965 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa13ffe-662c-419c-b7bc-040d7ede93ae None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:08.227164 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026141-df92-42d6-8eb1-d67d773e561d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:08.238814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 68/134] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:11:07 2022] PUT /identity/v3/projects/4d70b5c4b8974d0490b2b4d20326fa42/users/2a4b92f4861847f4b9f3dab965f7351b/roles/550a417973df4feda528c3e0787c1619 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:08.241513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d6cea-f019-4ab5-bbea-8882263c2884 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:08.241800 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d6cea-f019-4ab5-bbea-8882263c2884 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:08.242076 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d6cea-f019-4ab5-bbea-8882263c2884 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:08.244597 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 69/135] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:08.250934 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6915e7-3ea7-4c4b-9bd7-25e2dd7eb112 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:08.251261 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6915e7-3ea7-4c4b-9bd7-25e2dd7eb112 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:08.251636 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6915e7-3ea7-4c4b-9bd7-25e2dd7eb112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:08.273254 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f7e9-3827-4d68-b4b1-2e00d602ab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:08.274776 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f7e9-3827-4d68-b4b1-2e00d602ab1d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:08.275242 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f7e9-3827-4d68-b4b1-2e00d602ab1d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:08.275772 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae08f7e9-3827-4d68-b4b1-2e00d602ab1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:08.280600 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:08.287925 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ca6915e7-3ea7-4c4b-9bd7-25e2dd7eb112 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:08.289540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ca6915e7-3ea7-4c4b-9bd7-25e2dd7eb112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:08.378095 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:08.407376 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 70/136] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:08.429837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08f7e9-3827-4d68-b4b1-2e00d602ab1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:08.431811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae08f7e9-3827-4d68-b4b1-2e00d602ab1d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:08.551140 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 67/137] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:08.557046 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6915e7-3ea7-4c4b-9bd7-25e2dd7eb112 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:08.713911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6915e7-3ea7-4c4b-9bd7-25e2dd7eb112 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:08.761624 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b9f33-9385-437a-97fe-f4693d0dbf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:08.762665 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9f33-9385-437a-97fe-f4693d0dbf6a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:08.763170 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9f33-9385-437a-97fe-f4693d0dbf6a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:08.763643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b9f33-9385-437a-97fe-f4693d0dbf6a None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:08.764997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b9f33-9385-437a-97fe-f4693d0dbf6a None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:08.766695 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b9f33-9385-437a-97fe-f4693d0dbf6a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:08.768902 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 71/138] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:08 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:08.774808 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f7e9-3827-4d68-b4b1-2e00d602ab1d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:08.815302 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:08.840292 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b9f33-9385-437a-97fe-f4693d0dbf6a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:08.895872 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:08.912586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae08f7e9-3827-4d68-b4b1-2e00d602ab1d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:08.964617 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3145be-8e0b-49d2-84d8-3228bd6b4bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:08.966757 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3145be-8e0b-49d2-84d8-3228bd6b4bee None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:08.967419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3145be-8e0b-49d2-84d8-3228bd6b4bee None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:08.968448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3145be-8e0b-49d2-84d8-3228bd6b4bee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:08.970556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3145be-8e0b-49d2-84d8-3228bd6b4bee None admin] RBAC: Adding query filter params (role.id=32087f94c45f41e3bee5e95eda599d6f, scope.project.id=3d0a846940634bc59ecf00e3124e353c, user.id=d7dda5eabf1a4261bc62300812461389) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:08.971078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3145be-8e0b-49d2-84d8-3228bd6b4bee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:08.972888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3145be-8e0b-49d2-84d8-3228bd6b4bee None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:08.975566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b9f33-9385-437a-97fe-f4693d0dbf6a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:08.988590 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 68/139] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:08 2022] GET /identity/v3/role_assignments?user.id=d7dda5eabf1a4261bc62300812461389&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=32087f94c45f41e3bee5e95eda599d6f => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:08.990971 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000047e-27e1-41a4-aba0-a0e84acee946 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:08.991821 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000047e-27e1-41a4-aba0-a0e84acee946 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:08.994170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5000047e-27e1-41a4-aba0-a0e84acee946 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:08.996673 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 69/140] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:09.001901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939c09a-f32a-496c-8bd8-8dd19887de62 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:09.002543 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939c09a-f32a-496c-8bd8-8dd19887de62 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:09.003013 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939c09a-f32a-496c-8bd8-8dd19887de62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:09.039175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8939c09a-f32a-496c-8bd8-8dd19887de62 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:09.042316 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8939c09a-f32a-496c-8bd8-8dd19887de62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:09.049847 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d018158-0fea-4fa6-97d2-6a952294c990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:09.051762 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d018158-0fea-4fa6-97d2-6a952294c990 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:09.052918 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d018158-0fea-4fa6-97d2-6a952294c990 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:09.053639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d018158-0fea-4fa6-97d2-6a952294c990 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:09.077296 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d018158-0fea-4fa6-97d2-6a952294c990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3d018158-0fea-4fa6-97d2-6a952294c990 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:09.087035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:09.087999 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:09.088830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:09.095931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 72/141] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:09.105253 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d018158-0fea-4fa6-97d2-6a952294c990 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:09.182020 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 70/142] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:09.295532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d018158-0fea-4fa6-97d2-6a952294c990 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:09.303868 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:09.342083 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910ccc6-ba27-4085-a0af-73ec7e152dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:09.343130 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910ccc6-ba27-4085-a0af-73ec7e152dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:09.343612 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910ccc6-ba27-4085-a0af-73ec7e152dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:09.344368 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910ccc6-ba27-4085-a0af-73ec7e152dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:09.345229 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910ccc6-ba27-4085-a0af-73ec7e152dd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:09.345767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910ccc6-ba27-4085-a0af-73ec7e152dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:09.347391 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910ccc6-ba27-4085-a0af-73ec7e152dd9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:09.356145 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 73/143] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:09.362383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939c09a-f32a-496c-8bd8-8dd19887de62 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:09.420500 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:09.514904 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939c09a-f32a-496c-8bd8-8dd19887de62 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:09.560956 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54075803-4a53-44e8-ad9a-e5901fe5d3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:09.561510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54075803-4a53-44e8-ad9a-e5901fe5d3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:09.561791 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54075803-4a53-44e8-ad9a-e5901fe5d3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:09.562062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54075803-4a53-44e8-ad9a-e5901fe5d3b3 None admin] PATH_INFO: `/v3/users/2a4b92f4861847f4b9f3dab965f7351b` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:09.566338 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54075803-4a53-44e8-ad9a-e5901fe5d3b3 None admin] RBAC: Authorizing `identity:get_user(user_id=2a4b92f4861847f4b9f3dab965f7351b)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:09.567842 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54075803-4a53-44e8-ad9a-e5901fe5d3b3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:09.570071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 71/144] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:09 2022] GET /identity/v3/users/2a4b92f4861847f4b9f3dab965f7351b => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:09.575460 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910ccc6-ba27-4085-a0af-73ec7e152dd9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:09.704105 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910ccc6-ba27-4085-a0af-73ec7e152dd9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:09.732470 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54075803-4a53-44e8-ad9a-e5901fe5d3b3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:09.741965 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91389cb-3995-4876-babd-41c5c3ff8e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:09.742729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91389cb-3995-4876-babd-41c5c3ff8e15 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:09.743013 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91389cb-3995-4876-babd-41c5c3ff8e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:09.743338 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91389cb-3995-4876-babd-41c5c3ff8e15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:09.781725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:09.819535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91389cb-3995-4876-babd-41c5c3ff8e15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:09.821079 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91389cb-3995-4876-babd-41c5c3ff8e15 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:09.901839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54075803-4a53-44e8-ad9a-e5901fe5d3b3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:09.903448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:09.976372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a919ab-5778-4b3c-916e-71dbaa15e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:09.977011 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a919ab-5778-4b3c-916e-71dbaa15e751 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:09.977286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a919ab-5778-4b3c-916e-71dbaa15e751 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:09.977555 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a919ab-5778-4b3c-916e-71dbaa15e751 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:09.979943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 74/145] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:09.985238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91389cb-3995-4876-babd-41c5c3ff8e15 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:09.995634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a919ab-5778-4b3c-916e-71dbaa15e751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-35a919ab-5778-4b3c-916e-71dbaa15e751 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:10.006141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:10.007047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:10.007804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 72/146] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:10.024034 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a919ab-5778-4b3c-916e-71dbaa15e751 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:10.061251 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:10.100870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91389cb-3995-4876-babd-41c5c3ff8e15 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:10.136419 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e126c8-a9da-427b-8252-31431116ca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:10.137051 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e126c8-a9da-427b-8252-31431116ca70 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:10.137327 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e126c8-a9da-427b-8252-31431116ca70 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:10.137644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e126c8-a9da-427b-8252-31431116ca70 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:10.138789 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e126c8-a9da-427b-8252-31431116ca70 None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:10.141618 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e126c8-a9da-427b-8252-31431116ca70 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:10.143576 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 75/147] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:09 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:10.150370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e126c8-a9da-427b-8252-31431116ca70 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:10.179061 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a919ab-5778-4b3c-916e-71dbaa15e751 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:10.259843 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13a82b-2b8f-4a98-a45b-9c92d036742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:10.260852 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e126c8-a9da-427b-8252-31431116ca70 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:10.261051 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13a82b-2b8f-4a98-a45b-9c92d036742e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:10.261521 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13a82b-2b8f-4a98-a45b-9c92d036742e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:10.262006 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13a82b-2b8f-4a98-a45b-9c92d036742e None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:10.262901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13a82b-2b8f-4a98-a45b-9c92d036742e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:10.263409 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13a82b-2b8f-4a98-a45b-9c92d036742e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:10.265286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13a82b-2b8f-4a98-a45b-9c92d036742e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:10.285158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 73/148] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:10.286847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41f03-72d3-44c5-aaaf-e1d530de5385 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:10.287417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41f03-72d3-44c5-aaaf-e1d530de5385 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:10.287905 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e41f03-72d3-44c5-aaaf-e1d530de5385 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:10.289325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 74/149] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:10.295477 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299800b3-411d-48e9-9bbd-f398c61eb90b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:10.295993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299800b3-411d-48e9-9bbd-f398c61eb90b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:10.296486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299800b3-411d-48e9-9bbd-f398c61eb90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:10.304382 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474f82a-892c-4c5e-9164-19a96bc811dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:10.304382 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474f82a-892c-4c5e-9164-19a96bc811dc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:10.304382 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474f82a-892c-4c5e-9164-19a96bc811dc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:10.304966 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474f82a-892c-4c5e-9164-19a96bc811dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:10.305270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474f82a-892c-4c5e-9164-19a96bc811dc None admin] RBAC: Adding query filter params (role.id=550a417973df4feda528c3e0787c1619, scope.project.id=3d0a846940634bc59ecf00e3124e353c, user.id=2a4b92f4861847f4b9f3dab965f7351b) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:10.305580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474f82a-892c-4c5e-9164-19a96bc811dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:10.307087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474f82a-892c-4c5e-9164-19a96bc811dc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:10.308953 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:10.315191 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 76/150] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:10 2022] GET /identity/v3/role_assignments?user.id=2a4b92f4861847f4b9f3dab965f7351b&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=550a417973df4feda528c3e0787c1619 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:10.316194 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474f82a-892c-4c5e-9164-19a96bc811dc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:10.335063 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-299800b3-411d-48e9-9bbd-f398c61eb90b None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:10.336547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-299800b3-411d-48e9-9bbd-f398c61eb90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:10.365503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:10.432247 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474f82a-892c-4c5e-9164-19a96bc811dc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:10.470884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703e80-6711-4e21-b95e-1b7f06d1747c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:10.471619 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703e80-6711-4e21-b95e-1b7f06d1747c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:10.471902 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703e80-6711-4e21-b95e-1b7f06d1747c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:10.472172 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703e80-6711-4e21-b95e-1b7f06d1747c None admin] PATH_INFO: `/v3/users/2a4b92f4861847f4b9f3dab965f7351b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:10.473306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30703e80-6711-4e21-b95e-1b7f06d1747c None admin] RBAC: Authorizing `identity:get_user(user_id=2a4b92f4861847f4b9f3dab965f7351b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:10.475236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30703e80-6711-4e21-b95e-1b7f06d1747c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:10.475432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 75/151] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:10.476848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 77/152] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:10 2022] GET /identity/v3/users/2a4b92f4861847f4b9f3dab965f7351b => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:10.482418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299800b3-411d-48e9-9bbd-f398c61eb90b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:10.637848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299800b3-411d-48e9-9bbd-f398c61eb90b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:10.680803 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8815e5-8875-4f36-a4fe-950091a4412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:10.681425 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8815e5-8875-4f36-a4fe-950091a4412c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:10.681705 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8815e5-8875-4f36-a4fe-950091a4412c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:10.681981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8815e5-8875-4f36-a4fe-950091a4412c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:10.715278 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:10.776660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8815e5-8875-4f36-a4fe-950091a4412c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:10.778149 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8815e5-8875-4f36-a4fe-950091a4412c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:10.853468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703e80-6711-4e21-b95e-1b7f06d1747c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:10.939677 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 76/153] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:10.946575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8815e5-8875-4f36-a4fe-950091a4412c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:10.967848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:11.030257 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:11.032917 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703e80-6711-4e21-b95e-1b7f06d1747c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:11.091784 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8510d67-801b-451c-a5c9-5a9a3f59badc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:11.092916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510d67-801b-451c-a5c9-5a9a3f59badc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.094018 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510d67-801b-451c-a5c9-5a9a3f59badc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.094550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510d67-801b-451c-a5c9-5a9a3f59badc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.108151 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8815e5-8875-4f36-a4fe-950091a4412c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:11.109155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8510d67-801b-451c-a5c9-5a9a3f59badc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-c8510d67-801b-451c-a5c9-5a9a3f59badc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:11.117002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:11.117938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:11.118759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:11.120958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 78/154] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:11:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:11.127544 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0ee9-cdc6-42bd-a1d5-fdab97d0f0aa None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.128054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0ee9-cdc6-42bd-a1d5-fdab97d0f0aa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.128483 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e0ee9-cdc6-42bd-a1d5-fdab97d0f0aa None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.131103 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 79/155] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:11.133196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e0ee9-cdc6-42bd-a1d5-fdab97d0f0aa None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:11.154720 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef2f96-89c1-4f00-a445-3a3a0542b94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:11.155736 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2f96-89c1-4f00-a445-3a3a0542b94d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.156248 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2f96-89c1-4f00-a445-3a3a0542b94d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.156728 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef2f96-89c1-4f00-a445-3a3a0542b94d None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.158095 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef2f96-89c1-4f00-a445-3a3a0542b94d None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:11.159784 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef2f96-89c1-4f00-a445-3a3a0542b94d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:11.162188 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 77/156] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:10 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:11.163413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae564cb8-e055-4e5d-8dde-5eea91d895b7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.163842 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae564cb8-e055-4e5d-8dde-5eea91d895b7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.164227 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae564cb8-e055-4e5d-8dde-5eea91d895b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.184076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ae564cb8-e055-4e5d-8dde-5eea91d895b7 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:11.185430 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ae564cb8-e055-4e5d-8dde-5eea91d895b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:11.269248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e0ee9-cdc6-42bd-a1d5-fdab97d0f0aa None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:11.270031 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 78/157] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:11.278147 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae564cb8-e055-4e5d-8dde-5eea91d895b7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:11.324123 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:11.330914 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:11.332835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b40da-2d9c-4927-adf4-86a5922475ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:11.334239 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b40da-2d9c-4927-adf4-86a5922475ce None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.334518 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b40da-2d9c-4927-adf4-86a5922475ce None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.334870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b40da-2d9c-4927-adf4-86a5922475ce None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.335541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b40da-2d9c-4927-adf4-86a5922475ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:11.339514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b40da-2d9c-4927-adf4-86a5922475ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:11.339514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b40da-2d9c-4927-adf4-86a5922475ce None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:11.346398 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 80/158] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:11.347582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224ceb-9df5-451c-b534-5eca749e6768 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.347867 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224ceb-9df5-451c-b534-5eca749e6768 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.348185 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95224ceb-9df5-451c-b534-5eca749e6768 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.354538 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 81/159] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:11.355347 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224ceb-9df5-451c-b534-5eca749e6768 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:11.391623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae564cb8-e055-4e5d-8dde-5eea91d895b7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:11.430126 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55370a-ea03-4277-b5cb-8020145bd055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:11.430745 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55370a-ea03-4277-b5cb-8020145bd055 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.431031 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55370a-ea03-4277-b5cb-8020145bd055 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.431365 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55370a-ea03-4277-b5cb-8020145bd055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.432111 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55370a-ea03-4277-b5cb-8020145bd055 None admin] RBAC: Adding query filter params (role.id=adc491d8d49c47779e572883af3ed47e, scope.project.id=3d0a846940634bc59ecf00e3124e353c, user.id=2a4b92f4861847f4b9f3dab965f7351b) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:11.432422 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55370a-ea03-4277-b5cb-8020145bd055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:11.433875 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55370a-ea03-4277-b5cb-8020145bd055 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:11.440490 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 79/160] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:11 2022] GET /identity/v3/role_assignments?user.id=2a4b92f4861847f4b9f3dab965f7351b&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=adc491d8d49c47779e572883af3ed47e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:11.441946 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7006ce-0951-4b5f-b7db-5e8dab218a64 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.442356 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7006ce-0951-4b5f-b7db-5e8dab218a64 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.442668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7006ce-0951-4b5f-b7db-5e8dab218a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.463052 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-cf7006ce-0951-4b5f-b7db-5e8dab218a64 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:11.464366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-cf7006ce-0951-4b5f-b7db-5e8dab218a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:11.465036 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95224ceb-9df5-451c-b534-5eca749e6768 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:11.503938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c7b24-5ff9-41a5-ab77-7abf52769a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:11.504669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c7b24-5ff9-41a5-ab77-7abf52769a94 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.505056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c7b24-5ff9-41a5-ab77-7abf52769a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.505523 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c7b24-5ff9-41a5-ab77-7abf52769a94 None admin] PATH_INFO: `/v3/users/97d2196009fa44f294707c6fd6554a9d` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.506738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c7b24-5ff9-41a5-ab77-7abf52769a94 None admin] RBAC: Authorizing `identity:get_user(user_id=97d2196009fa44f294707c6fd6554a9d)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:11.508283 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c7b24-5ff9-41a5-ab77-7abf52769a94 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:11.510335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 82/161] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:11 2022] GET /identity/v3/users/97d2196009fa44f294707c6fd6554a9d => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:11.519796 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c7b24-5ff9-41a5-ab77-7abf52769a94 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:11.581774 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 80/162] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:11.587331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7006ce-0951-4b5f-b7db-5e8dab218a64 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:11.635334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:11.652035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:11.685637 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c7b24-5ff9-41a5-ab77-7abf52769a94 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:11.716774 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7006ce-0951-4b5f-b7db-5e8dab218a64 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:11.746543 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e1df8-229f-490b-9690-75bc35b239ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:11.747236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1df8-229f-490b-9690-75bc35b239ab None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.747425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1df8-229f-490b-9690-75bc35b239ab None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.747701 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1df8-229f-490b-9690-75bc35b239ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.757217 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e23a6d-5bff-4b74-b28c-ffcd5c8d89fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:11.758212 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23a6d-5bff-4b74-b28c-ffcd5c8d89fd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.758798 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23a6d-5bff-4b74-b28c-ffcd5c8d89fd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.759311 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e23a6d-5bff-4b74-b28c-ffcd5c8d89fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.771101 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e23a6d-5bff-4b74-b28c-ffcd5c8d89fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a6e23a6d-5bff-4b74-b28c-ffcd5c8d89fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:11.776595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:11.777439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:11.778749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:11.780844 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 81/163] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:11.782308 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b252459-0828-44e0-a816-7a00467c5e1f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.782587 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b252459-0828-44e0-a816-7a00467c5e1f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.782978 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b252459-0828-44e0-a816-7a00467c5e1f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.784759 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 82/164] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:11.790869 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab109ea-973a-43da-adc9-5d02a3e3b6fd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:11.791464 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab109ea-973a-43da-adc9-5d02a3e3b6fd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:11.791747 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab109ea-973a-43da-adc9-5d02a3e3b6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:11.811166 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9ab109ea-973a-43da-adc9-5d02a3e3b6fd None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:11.812353 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9ab109ea-973a-43da-adc9-5d02a3e3b6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:11.826717 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e1df8-229f-490b-9690-75bc35b239ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:11.828417 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e1df8-229f-490b-9690-75bc35b239ab None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:11.880460 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 83/165] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:11.881807 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab109ea-973a-43da-adc9-5d02a3e3b6fd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:11.889737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:11.916374 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:11.941568 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 83/166] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:11.942662 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e1df8-229f-490b-9690-75bc35b239ab None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:11.987536 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab109ea-973a-43da-adc9-5d02a3e3b6fd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:12.022772 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb8054-bf5f-49dd-b679-8740b171fcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:12.023304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb8054-bf5f-49dd-b679-8740b171fcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:12.023583 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb8054-bf5f-49dd-b679-8740b171fcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:12.023853 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb8054-bf5f-49dd-b679-8740b171fcc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:12.024513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb8054-bf5f-49dd-b679-8740b171fcc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:12.024811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb8054-bf5f-49dd-b679-8740b171fcc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:12.026240 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb8054-bf5f-49dd-b679-8740b171fcc0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:12.034669 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 84/167] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:12.035578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb8054-bf5f-49dd-b679-8740b171fcc0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:12.061560 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e1df8-229f-490b-9690-75bc35b239ab None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:12.098438 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab3266-0c33-47aa-a9fc-c44377978b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:12.099704 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3266-0c33-47aa-a9fc-c44377978b0a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:12.100087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3266-0c33-47aa-a9fc-c44377978b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:12.100347 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab3266-0c33-47aa-a9fc-c44377978b0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:12.101440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab3266-0c33-47aa-a9fc-c44377978b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:12.102906 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab3266-0c33-47aa-a9fc-c44377978b0a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:12.104702 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 84/168] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:12.106929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab3266-0c33-47aa-a9fc-c44377978b0a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:12.134309 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:12.137840 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:12.140161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb8054-bf5f-49dd-b679-8740b171fcc0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:12.174964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e22c9-58ac-4ce4-9bb2-21036ad44989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:12.175588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e22c9-58ac-4ce4-9bb2-21036ad44989 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:12.175866 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e22c9-58ac-4ce4-9bb2-21036ad44989 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:12.176135 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e22c9-58ac-4ce4-9bb2-21036ad44989 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:12.177269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e22c9-58ac-4ce4-9bb2-21036ad44989 None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:12.182086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e22c9-58ac-4ce4-9bb2-21036ad44989 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:12.182086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 85/169] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:12 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:12.182086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e22c9-58ac-4ce4-9bb2-21036ad44989 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:12.222671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab3266-0c33-47aa-a9fc-c44377978b0a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:12.257308 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468a964-555e-4373-82cb-04d0194be911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:12.258302 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468a964-555e-4373-82cb-04d0194be911 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:12.258586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468a964-555e-4373-82cb-04d0194be911 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:12.259179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468a964-555e-4373-82cb-04d0194be911 None admin] PATH_INFO: `/v3/users/2a4b92f4861847f4b9f3dab965f7351b` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:12.260306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468a964-555e-4373-82cb-04d0194be911 None admin] RBAC: Authorizing `identity:get_user(user_id=2a4b92f4861847f4b9f3dab965f7351b)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:12.261733 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468a964-555e-4373-82cb-04d0194be911 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:12.263343 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 85/170] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:12 2022] GET /identity/v3/users/2a4b92f4861847f4b9f3dab965f7351b => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:12.266689 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468a964-555e-4373-82cb-04d0194be911 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:12.282342 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e22c9-58ac-4ce4-9bb2-21036ad44989 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:12.316028 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce411b5-d2aa-4a38-b97b-d2f5ba14ff33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:12.316625 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce411b5-d2aa-4a38-b97b-d2f5ba14ff33 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:12.316908 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce411b5-d2aa-4a38-b97b-d2f5ba14ff33 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:12.317175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce411b5-d2aa-4a38-b97b-d2f5ba14ff33 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:12.317845 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce411b5-d2aa-4a38-b97b-d2f5ba14ff33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:12.319321 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce411b5-d2aa-4a38-b97b-d2f5ba14ff33 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:12.356147 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:12.364530 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468a964-555e-4373-82cb-04d0194be911 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:12.394543 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 86/171] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:11:12 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:12.397503 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3ed5d-9ea8-433e-b232-1c8f783310f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:12.398171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3ed5d-9ea8-433e-b232-1c8f783310f4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:12.398452 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3ed5d-9ea8-433e-b232-1c8f783310f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:12.398720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3ed5d-9ea8-433e-b232-1c8f783310f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:12.399801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce411b5-d2aa-4a38-b97b-d2f5ba14ff33 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:12.410673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3ed5d-9ea8-433e-b232-1c8f783310f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-19a3ed5d-9ea8-433e-b232-1c8f783310f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:12.416441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:12.417600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 86/172] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:12.423781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3ed5d-9ea8-433e-b232-1c8f783310f4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:12.428518 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:12.529747 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce411b5-d2aa-4a38-b97b-d2f5ba14ff33 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:12.537812 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3ed5d-9ea8-433e-b232-1c8f783310f4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:12.571333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241b656-6c15-43d3-b659-3d6d1effb9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:12.571942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241b656-6c15-43d3-b659-3d6d1effb9dc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:12.572219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241b656-6c15-43d3-b659-3d6d1effb9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:12.572875 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241b656-6c15-43d3-b659-3d6d1effb9dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:12.573206 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241b656-6c15-43d3-b659-3d6d1effb9dc None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=3d0a846940634bc59ecf00e3124e353c, user.id=97d2196009fa44f294707c6fd6554a9d) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:12.574147 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241b656-6c15-43d3-b659-3d6d1effb9dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:12.574977 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241b656-6c15-43d3-b659-3d6d1effb9dc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:12.580706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b000e21-3e45-4423-a01d-b3cf79815082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:12.581316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b000e21-3e45-4423-a01d-b3cf79815082 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:12.581594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b000e21-3e45-4423-a01d-b3cf79815082 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:12.581859 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b000e21-3e45-4423-a01d-b3cf79815082 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:12.583254 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 87/173] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:12 2022] GET /identity/v3/role_assignments?user.id=97d2196009fa44f294707c6fd6554a9d&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=afe88bc03d30494b89892587177c79de => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:12.584093 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241b656-6c15-43d3-b659-3d6d1effb9dc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:12.622550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:12.689180 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b000e21-3e45-4423-a01d-b3cf79815082 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:12.691013 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b000e21-3e45-4423-a01d-b3cf79815082 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:12.713310 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:12.744583 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241b656-6c15-43d3-b659-3d6d1effb9dc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:12.794718 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35390a7c-b000-48dd-8e8e-e2a31d4559d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:12.795261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35390a7c-b000-48dd-8e8e-e2a31d4559d1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:12.795806 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35390a7c-b000-48dd-8e8e-e2a31d4559d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:12.796082 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35390a7c-b000-48dd-8e8e-e2a31d4559d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:12.797238 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35390a7c-b000-48dd-8e8e-e2a31d4559d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:12.797614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35390a7c-b000-48dd-8e8e-e2a31d4559d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:12.799349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35390a7c-b000-48dd-8e8e-e2a31d4559d1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:12.811681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 88/174] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:12.817837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35390a7c-b000-48dd-8e8e-e2a31d4559d1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:12.823796 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 87/175] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:12.830574 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b000e21-3e45-4423-a01d-b3cf79815082 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:12.893019 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:12.955316 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35390a7c-b000-48dd-8e8e-e2a31d4559d1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:12.956095 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b000e21-3e45-4423-a01d-b3cf79815082 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:13.000745 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a0ec3-e853-47b1-ab97-87ae1c48907a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:13.000745 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a0ec3-e853-47b1-ab97-87ae1c48907a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:13.000745 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a0ec3-e853-47b1-ab97-87ae1c48907a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:13.000745 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a0ec3-e853-47b1-ab97-87ae1c48907a None admin] PATH_INFO: `/v3/users/d7dda5eabf1a4261bc62300812461389` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:13.002196 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a0ec3-e853-47b1-ab97-87ae1c48907a None admin] RBAC: Authorizing `identity:get_user(user_id=d7dda5eabf1a4261bc62300812461389)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:13.003658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a0ec3-e853-47b1-ab97-87ae1c48907a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:13.005634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 89/176] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:12 2022] GET /identity/v3/users/d7dda5eabf1a4261bc62300812461389 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:13.007594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc4469-138b-42fb-ab7a-d80428c412c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:13.008237 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc4469-138b-42fb-ab7a-d80428c412c9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:13.008513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc4469-138b-42fb-ab7a-d80428c412c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:13.008784 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc4469-138b-42fb-ab7a-d80428c412c9 None admin] PATH_INFO: `/v3/projects/4d70b5c4b8974d0490b2b4d20326fa42` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:13.009934 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc4469-138b-42fb-ab7a-d80428c412c9 None admin] RBAC: Authorizing `identity:get_project(project_id=4d70b5c4b8974d0490b2b4d20326fa42)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:13.011410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc4469-138b-42fb-ab7a-d80428c412c9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:13.013146 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 88/177] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:12 2022] GET /identity/v3/projects/4d70b5c4b8974d0490b2b4d20326fa42 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:13.014182 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a0ec3-e853-47b1-ab97-87ae1c48907a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:13.020258 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc4469-138b-42fb-ab7a-d80428c412c9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:13.034439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:13.147813 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a0ec3-e853-47b1-ab97-87ae1c48907a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:13.155166 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc4469-138b-42fb-ab7a-d80428c412c9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:13.183791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:13.198268 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574377e-2558-4d86-8f4f-792dc6e2c9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:13.198268 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574377e-2558-4d86-8f4f-792dc6e2c9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:13.198268 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574377e-2558-4d86-8f4f-792dc6e2c9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:13.198268 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574377e-2558-4d86-8f4f-792dc6e2c9d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:13.198708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574377e-2558-4d86-8f4f-792dc6e2c9d8 None admin] RBAC: Adding query filter params (role.id=550a417973df4feda528c3e0787c1619, scope.project.id=4d70b5c4b8974d0490b2b4d20326fa42, user.id=2a4b92f4861847f4b9f3dab965f7351b) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:13.198708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574377e-2558-4d86-8f4f-792dc6e2c9d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:13.199206 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574377e-2558-4d86-8f4f-792dc6e2c9d8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:13.212257 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 89/178] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:13 2022] GET /identity/v3/role_assignments?user.id=2a4b92f4861847f4b9f3dab965f7351b&scope.project.id=4d70b5c4b8974d0490b2b4d20326fa42&role.id=550a417973df4feda528c3e0787c1619 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:13.220746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ad7ac-ecdf-401f-a598-b0622272b4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:13.221628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ad7ac-ecdf-401f-a598-b0622272b4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:13.222053 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ad7ac-ecdf-401f-a598-b0622272b4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:13.222533 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ad7ac-ecdf-401f-a598-b0622272b4f9 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:13.223864 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ad7ac-ecdf-401f-a598-b0622272b4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:13.225470 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ad7ac-ecdf-401f-a598-b0622272b4f9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:13.227319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 90/179] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:13 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:13.233351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574377e-2558-4d86-8f4f-792dc6e2c9d8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:13.378266 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574377e-2558-4d86-8f4f-792dc6e2c9d8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:13.419810 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237a51f-2d1a-473f-a413-e13d0d080ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:13.420590 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a51f-2d1a-473f-a413-e13d0d080ad2 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:13.420868 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a51f-2d1a-473f-a413-e13d0d080ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:13.421135 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237a51f-2d1a-473f-a413-e13d0d080ad2 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c/users/d7dda5eabf1a4261bc62300812461389/roles/32087f94c45f41e3bee5e95eda599d6f` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:13.423072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237a51f-2d1a-473f-a413-e13d0d080ad2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d0a846940634bc59ecf00e3124e353c, user_id=d7dda5eabf1a4261bc62300812461389, role_id=32087f94c45f41e3bee5e95eda599d6f)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:13.424522 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237a51f-2d1a-473f-a413-e13d0d080ad2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:13.504402 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 90/180] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:11:13 2022] PUT /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c/users/d7dda5eabf1a4261bc62300812461389/roles/32087f94c45f41e3bee5e95eda599d6f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:14.695525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8196-43b2-441e-8ca6-c76e8e4893f5 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:14.696122 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8196-43b2-441e-8ca6-c76e8e4893f5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:14.696122 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e8196-43b2-441e-8ca6-c76e8e4893f5 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:14.697554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 91/181] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:14.702729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffdaae-eb8f-4b67-8742-3d091874dd0c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:14.703189 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffdaae-eb8f-4b67-8742-3d091874dd0c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:14.703366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffdaae-eb8f-4b67-8742-3d091874dd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:14.722302 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-14ffdaae-eb8f-4b67-8742-3d091874dd0c None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:14.723503 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-14ffdaae-eb8f-4b67-8742-3d091874dd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:14.766579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:14.794578 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 91/182] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:14.953508 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991772bc-4717-4b6d-813f-9c0e20061958 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:14.953889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991772bc-4717-4b6d-813f-9c0e20061958 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:14.954067 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991772bc-4717-4b6d-813f-9c0e20061958 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:14.955564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 92/183] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:14.961003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6449a49-6096-42e1-b694-bc099db219a6 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:14.961294 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6449a49-6096-42e1-b694-bc099db219a6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:14.961573 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6449a49-6096-42e1-b694-bc099db219a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:14.979456 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e92b43-02d3-4a9f-bc3e-4e6fb630d3f6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:14.979771 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e92b43-02d3-4a9f-bc3e-4e6fb630d3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:14.980041 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e92b43-02d3-4a9f-bc3e-4e6fb630d3f6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:14.980848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b6449a49-6096-42e1-b694-bc099db219a6 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:14.981430 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 93/184] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:14.982192 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b6449a49-6096-42e1-b694-bc099db219a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:14.988139 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd610e8-ddfa-448c-9b43-16b8f4a1150e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:14.988417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd610e8-ddfa-448c-9b43-16b8f4a1150e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:14.988686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd610e8-ddfa-448c-9b43-16b8f4a1150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:15.008169 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-fbd610e8-ddfa-448c-9b43-16b8f4a1150e None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:15.009549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fbd610e8-ddfa-448c-9b43-16b8f4a1150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:15.054796 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 92/185] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:15.081516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 94/186] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:15.085933 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6449a49-6096-42e1-b694-bc099db219a6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:15.188712 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6449a49-6096-42e1-b694-bc099db219a6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:15.191083 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:15.224606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2700bb-dd2e-491a-9457-b51825199cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:15.225157 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2700bb-dd2e-491a-9457-b51825199cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:15.225437 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2700bb-dd2e-491a-9457-b51825199cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:15.225769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2700bb-dd2e-491a-9457-b51825199cb6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:15.236406 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2700bb-dd2e-491a-9457-b51825199cb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-fb2700bb-dd2e-491a-9457-b51825199cb6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:15.241175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:15.242064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:15.242909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 93/187] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:15.248200 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd610e8-ddfa-448c-9b43-16b8f4a1150e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:15.260395 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:15.330192 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2700bb-dd2e-491a-9457-b51825199cb6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:15.354711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd610e8-ddfa-448c-9b43-16b8f4a1150e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:15.390727 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c474-04cf-4f61-a2e7-a528aadadb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:15.391341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c474-04cf-4f61-a2e7-a528aadadb53 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:15.391626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c474-04cf-4f61-a2e7-a528aadadb53 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:15.391890 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06c474-04cf-4f61-a2e7-a528aadadb53 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:15.392555 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c474-04cf-4f61-a2e7-a528aadadb53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:15.392852 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c474-04cf-4f61-a2e7-a528aadadb53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:15.394240 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06c474-04cf-4f61-a2e7-a528aadadb53 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:15.406144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 95/188] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:15.406144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c474-04cf-4f61-a2e7-a528aadadb53 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:15.445318 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2700bb-dd2e-491a-9457-b51825199cb6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:15.482928 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf794b6c-52bb-407e-9044-ae2a0a251fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:15.483471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794b6c-52bb-407e-9044-ae2a0a251fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:15.483755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794b6c-52bb-407e-9044-ae2a0a251fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:15.484027 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794b6c-52bb-407e-9044-ae2a0a251fd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:15.485148 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf794b6c-52bb-407e-9044-ae2a0a251fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:15.485922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:15.486788 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf794b6c-52bb-407e-9044-ae2a0a251fd3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:15.488419 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 94/189] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:15.489210 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf794b6c-52bb-407e-9044-ae2a0a251fd3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:15.516688 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06c474-04cf-4f61-a2e7-a528aadadb53 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:15.523336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:15.549826 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a81f3-d619-4fd0-8d2f-5a3feba7455b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:15.550471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a81f3-d619-4fd0-8d2f-5a3feba7455b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:15.550745 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a81f3-d619-4fd0-8d2f-5a3feba7455b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:15.551013 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a81f3-d619-4fd0-8d2f-5a3feba7455b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:15.560978 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a81f3-d619-4fd0-8d2f-5a3feba7455b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-969a81f3-d619-4fd0-8d2f-5a3feba7455b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:15.566271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:15.567861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 96/190] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:15.569086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a81f3-d619-4fd0-8d2f-5a3feba7455b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:15.598257 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf794b6c-52bb-407e-9044-ae2a0a251fd3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:15.632153 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4286a-89c7-40e8-9064-29a9aa02a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:15.632767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4286a-89c7-40e8-9064-29a9aa02a0cb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:15.633041 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4286a-89c7-40e8-9064-29a9aa02a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:15.633306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4286a-89c7-40e8-9064-29a9aa02a0cb None admin] PATH_INFO: `/v3/users/c68d73c83ca8481c81b8a54779ac6979` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:15.646941 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4286a-89c7-40e8-9064-29a9aa02a0cb None admin] RBAC: Authorizing `identity:get_user(user_id=c68d73c83ca8481c81b8a54779ac6979)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:15.648381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4286a-89c7-40e8-9064-29a9aa02a0cb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:15.649956 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 95/191] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:15 2022] GET /identity/v3/users/c68d73c83ca8481c81b8a54779ac6979 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:15.654991 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e855fe-2655-4a06-814a-f587c92db29e None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:15.654991 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e855fe-2655-4a06-814a-f587c92db29e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:15.654991 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e855fe-2655-4a06-814a-f587c92db29e None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:15.654991 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 96/192] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:15.654991 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e855fe-2655-4a06-814a-f587c92db29e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:15.678642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a81f3-d619-4fd0-8d2f-5a3feba7455b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:15.706987 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:15.712525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296c84e-a377-4ffb-b774-d0d140483289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:15.715969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c84e-a377-4ffb-b774-d0d140483289 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:15.715969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c84e-a377-4ffb-b774-d0d140483289 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:15.715969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c84e-a377-4ffb-b774-d0d140483289 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:15.715969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296c84e-a377-4ffb-b774-d0d140483289 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:15.715969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296c84e-a377-4ffb-b774-d0d140483289 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:15.744117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:15.754225 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e855fe-2655-4a06-814a-f587c92db29e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:15.787434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71017d3a-19d4-436c-9829-9fe40c3ba27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:15.788029 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017d3a-19d4-436c-9829-9fe40c3ba27c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:15.788313 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017d3a-19d4-436c-9829-9fe40c3ba27c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:15.788587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017d3a-19d4-436c-9829-9fe40c3ba27c None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:15.789249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71017d3a-19d4-436c-9829-9fe40c3ba27c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:15.789553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71017d3a-19d4-436c-9829-9fe40c3ba27c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:15.791002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71017d3a-19d4-436c-9829-9fe40c3ba27c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:15.798619 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 97/193] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:15.799409 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71017d3a-19d4-436c-9829-9fe40c3ba27c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:15.818008 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 97/194] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:11:15 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:15.818008 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36473d61-0f32-4a7f-a39c-59d68bd26ba3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:15.818008 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36473d61-0f32-4a7f-a39c-59d68bd26ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:15.818008 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36473d61-0f32-4a7f-a39c-59d68bd26ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:15.833984 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-36473d61-0f32-4a7f-a39c-59d68bd26ba3 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:15.835310 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-36473d61-0f32-4a7f-a39c-59d68bd26ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:15.915882 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 98/195] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:15.917138 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36473d61-0f32-4a7f-a39c-59d68bd26ba3 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:15.938866 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71017d3a-19d4-436c-9829-9fe40c3ba27c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:15.981404 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7daebd-ee36-4fd0-aa2d-42c482d1aeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:15.982061 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7daebd-ee36-4fd0-aa2d-42c482d1aeaf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:15.982381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7daebd-ee36-4fd0-aa2d-42c482d1aeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:15.983021 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7daebd-ee36-4fd0-aa2d-42c482d1aeaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:16.016367 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:16.058901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36473d61-0f32-4a7f-a39c-59d68bd26ba3 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:16.085540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7daebd-ee36-4fd0-aa2d-42c482d1aeaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:16.087074 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7daebd-ee36-4fd0-aa2d-42c482d1aeaf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:16.087552 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:16.116421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a072a-c976-4048-9191-822274170c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:16.117241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a072a-c976-4048-9191-822274170c69 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:16.117533 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a072a-c976-4048-9191-822274170c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:16.117975 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576a072a-c976-4048-9191-822274170c69 None admin] PATH_INFO: `/v3/users/c68d73c83ca8481c81b8a54779ac6979` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:16.120020 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a072a-c976-4048-9191-822274170c69 None admin] RBAC: Authorizing `identity:get_user(user_id=c68d73c83ca8481c81b8a54779ac6979)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:16.121621 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576a072a-c976-4048-9191-822274170c69 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:16.123763 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 99/196] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:15 2022] GET /identity/v3/users/c68d73c83ca8481c81b8a54779ac6979 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:16.129743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a072a-c976-4048-9191-822274170c69 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:16.221719 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 98/197] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:16.222945 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7daebd-ee36-4fd0-aa2d-42c482d1aeaf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:16.279288 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576a072a-c976-4048-9191-822274170c69 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:16.286737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:16.318971 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32083266-7edb-40d3-b076-0d6b04cfd35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:16.319586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32083266-7edb-40d3-b076-0d6b04cfd35b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:16.319865 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32083266-7edb-40d3-b076-0d6b04cfd35b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:16.320143 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32083266-7edb-40d3-b076-0d6b04cfd35b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:16.353118 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7daebd-ee36-4fd0-aa2d-42c482d1aeaf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:16.377952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:16.392124 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32083266-7edb-40d3-b076-0d6b04cfd35b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:16.393806 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32083266-7edb-40d3-b076-0d6b04cfd35b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:16.398610 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed48c5-eda9-411d-9a0b-06040b9c3d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:16.399266 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed48c5-eda9-411d-9a0b-06040b9c3d0e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:16.399548 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed48c5-eda9-411d-9a0b-06040b9c3d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:16.399821 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed48c5-eda9-411d-9a0b-06040b9c3d0e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:16.415545 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed48c5-eda9-411d-9a0b-06040b9c3d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-03ed48c5-eda9-411d-9a0b-06040b9c3d0e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:16.420332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:16.421195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:16.421981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 99/198] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:16.430892 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed48c5-eda9-411d-9a0b-06040b9c3d0e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:16.520741 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 100/199] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 07:11:16.526334 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32083266-7edb-40d3-b076-0d6b04cfd35b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:16.547884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed48c5-eda9-411d-9a0b-06040b9c3d0e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:16.566599 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:16.586656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b85e23-d841-4c67-8d64-5dae05192010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:16.590145 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b85e23-d841-4c67-8d64-5dae05192010 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:16.590145 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b85e23-d841-4c67-8d64-5dae05192010 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:16.590145 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b85e23-d841-4c67-8d64-5dae05192010 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:16.590145 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b85e23-d841-4c67-8d64-5dae05192010 None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:16.591958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b85e23-d841-4c67-8d64-5dae05192010 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:16.595365 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 100/200] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:16 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:16.596681 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b85e23-d841-4c67-8d64-5dae05192010 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:16.624073 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:16.639953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32083266-7edb-40d3-b076-0d6b04cfd35b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:16.678636 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989356-2c7b-4c33-ba74-ea7187dd08d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:16.679261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989356-2c7b-4c33-ba74-ea7187dd08d6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:16.679535 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989356-2c7b-4c33-ba74-ea7187dd08d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:16.679801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50989356-2c7b-4c33-ba74-ea7187dd08d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:16.680464 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50989356-2c7b-4c33-ba74-ea7187dd08d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:16.680763 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50989356-2c7b-4c33-ba74-ea7187dd08d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:16.682160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50989356-2c7b-4c33-ba74-ea7187dd08d6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:16.691175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 101/201] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:16.692095 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989356-2c7b-4c33-ba74-ea7187dd08d6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:16.731354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b85e23-d841-4c67-8d64-5dae05192010 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:16.777137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01a642-54d3-47c7-bac4-eb95525d5281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:16.778822 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a642-54d3-47c7-bac4-eb95525d5281 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:16.779106 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a642-54d3-47c7-bac4-eb95525d5281 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:16.779380 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c01a642-54d3-47c7-bac4-eb95525d5281 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:16.781785 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01a642-54d3-47c7-bac4-eb95525d5281 None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:16.783356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c01a642-54d3-47c7-bac4-eb95525d5281 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:16.784905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 101/202] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:16 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:16.790512 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01a642-54d3-47c7-bac4-eb95525d5281 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:16.810803 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50989356-2c7b-4c33-ba74-ea7187dd08d6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:16.850506 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d26f8c-5a14-4b8c-947c-1c7e346c4397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:16.851436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:16.852001 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26f8c-5a14-4b8c-947c-1c7e346c4397 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:16.853107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26f8c-5a14-4b8c-947c-1c7e346c4397 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:16.853581 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26f8c-5a14-4b8c-947c-1c7e346c4397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:16.854538 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d26f8c-5a14-4b8c-947c-1c7e346c4397 None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=bc5ad8f68599461690aa33f7d63a0536, user.id=c68d73c83ca8481c81b8a54779ac6979) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:16.855249 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d26f8c-5a14-4b8c-947c-1c7e346c4397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:16.857031 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d26f8c-5a14-4b8c-947c-1c7e346c4397 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:16.863202 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 102/203] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:16 2022] GET /identity/v3/role_assignments?user.id=c68d73c83ca8481c81b8a54779ac6979&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=afe88bc03d30494b89892587177c79de => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:16.869293 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d26f8c-5a14-4b8c-947c-1c7e346c4397 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:16.881988 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:16.931043 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c01a642-54d3-47c7-bac4-eb95525d5281 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:17.011878 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd4994-af80-445a-8613-c94f54d46de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:17.012518 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4994-af80-445a-8613-c94f54d46de2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:17.012798 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4994-af80-445a-8613-c94f54d46de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:17.013071 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd4994-af80-445a-8613-c94f54d46de2 None admin] PATH_INFO: `/v3/users/d7dda5eabf1a4261bc62300812461389` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:17.014307 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd4994-af80-445a-8613-c94f54d46de2 None admin] RBAC: Authorizing `identity:get_user(user_id=d7dda5eabf1a4261bc62300812461389)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:17.017168 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd4994-af80-445a-8613-c94f54d46de2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:17.018828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 102/204] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:16 2022] GET /identity/v3/users/d7dda5eabf1a4261bc62300812461389 => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:17.025602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd4994-af80-445a-8613-c94f54d46de2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:17.058585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d26f8c-5a14-4b8c-947c-1c7e346c4397 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:17.132473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1813181-c1cf-4c2a-914c-ad5ddf06e0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:17.133003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1813181-c1cf-4c2a-914c-ad5ddf06e0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:17.133283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1813181-c1cf-4c2a-914c-ad5ddf06e0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:17.133556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1813181-c1cf-4c2a-914c-ad5ddf06e0a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:17.134315 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1813181-c1cf-4c2a-914c-ad5ddf06e0a2 None admin] RBAC: Adding query filter params (role.id=adc491d8d49c47779e572883af3ed47e, scope.project.id=bc5ad8f68599461690aa33f7d63a0536, user.id=c68d73c83ca8481c81b8a54779ac6979) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:17.134623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1813181-c1cf-4c2a-914c-ad5ddf06e0a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:17.136096 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1813181-c1cf-4c2a-914c-ad5ddf06e0a2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:17.142485 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 103/205] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:16 2022] GET /identity/v3/role_assignments?user.id=c68d73c83ca8481c81b8a54779ac6979&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=adc491d8d49c47779e572883af3ed47e => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:17.216509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd4994-af80-445a-8613-c94f54d46de2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:17.241871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:17.268437 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fea1b3-59ce-4c6f-a436-b2e6e7db15ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:17.269064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fea1b3-59ce-4c6f-a436-b2e6e7db15ca None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:17.269346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fea1b3-59ce-4c6f-a436-b2e6e7db15ca None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:17.269706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fea1b3-59ce-4c6f-a436-b2e6e7db15ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:17.350852 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fea1b3-59ce-4c6f-a436-b2e6e7db15ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:17.352320 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fea1b3-59ce-4c6f-a436-b2e6e7db15ca None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:17.474542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 103/206] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:17.480391 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1813181-c1cf-4c2a-914c-ad5ddf06e0a2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:17.568424 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:17.594163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1813181-c1cf-4c2a-914c-ad5ddf06e0a2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:17.629770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f00cc0-17df-464d-bcbf-aab58d04b35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:17.631147 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f00cc0-17df-464d-bcbf-aab58d04b35c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:17.631917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f00cc0-17df-464d-bcbf-aab58d04b35c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:17.632197 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f00cc0-17df-464d-bcbf-aab58d04b35c None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:17.633415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f00cc0-17df-464d-bcbf-aab58d04b35c None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:17.634889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f00cc0-17df-464d-bcbf-aab58d04b35c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:17.636825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 104/207] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:17 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:17.642698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fea1b3-59ce-4c6f-a436-b2e6e7db15ca None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:17.664475 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:17.777371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fea1b3-59ce-4c6f-a436-b2e6e7db15ca None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:17.815248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2f81f-9d6c-4ba3-810d-396956586cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:17.815864 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2f81f-9d6c-4ba3-810d-396956586cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:17.816139 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2f81f-9d6c-4ba3-810d-396956586cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:17.816412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2f81f-9d6c-4ba3-810d-396956586cd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:17.817166 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2f81f-9d6c-4ba3-810d-396956586cd7 None admin] RBAC: Adding query filter params (role.id=32087f94c45f41e3bee5e95eda599d6f, scope.project.id=3d0a846940634bc59ecf00e3124e353c, user.id=d7dda5eabf1a4261bc62300812461389) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:17.817540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2f81f-9d6c-4ba3-810d-396956586cd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:17.819045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2f81f-9d6c-4ba3-810d-396956586cd7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:17.825035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 104/208] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:17 2022] GET /identity/v3/role_assignments?user.id=d7dda5eabf1a4261bc62300812461389&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=32087f94c45f41e3bee5e95eda599d6f => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:18.300578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3edec-aeb6-4a01-99c4-4f291840a884 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:18.301076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3edec-aeb6-4a01-99c4-4f291840a884 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:18.301150 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3edec-aeb6-4a01-99c4-4f291840a884 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:18.303322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 105/209] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:18.308828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a584461-e12b-412e-82a5-6d824370d1ab None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:18.309331 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a584461-e12b-412e-82a5-6d824370d1ab None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:18.309799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a584461-e12b-412e-82a5-6d824370d1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:18.329297 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3a584461-e12b-412e-82a5-6d824370d1ab None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:18.330826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3a584461-e12b-412e-82a5-6d824370d1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:18.390658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837c5b-3110-4454-9a93-467c6b4cd0b4 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:18.390962 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837c5b-3110-4454-9a93-467c6b4cd0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:18.391219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c837c5b-3110-4454-9a93-467c6b4cd0b4 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:18.393460 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 106/210] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:18.398507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb11ec4-06bf-4e9d-88cf-47d870f02ccc None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:18.398889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb11ec4-06bf-4e9d-88cf-47d870f02ccc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:18.399258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb11ec4-06bf-4e9d-88cf-47d870f02ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:18.414776 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 105/211] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:18.422231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-abb11ec4-06bf-4e9d-88cf-47d870f02ccc None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:18.427958 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-abb11ec4-06bf-4e9d-88cf-47d870f02ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:18.501153 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 107/212] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:18.700362 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a584461-e12b-412e-82a5-6d824370d1ab None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:18.713492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:18.782596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb11ec4-06bf-4e9d-88cf-47d870f02ccc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:18.810641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a584461-e12b-412e-82a5-6d824370d1ab None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:18.846138 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7d4d-6315-4bf3-add9-7d72d7784d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:18.846606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7d4d-6315-4bf3-add9-7d72d7784d17 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:18.846888 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7d4d-6315-4bf3-add9-7d72d7784d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:18.847164 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7d4d-6315-4bf3-add9-7d72d7784d17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:18.848287 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d7d4d-6315-4bf3-add9-7d72d7784d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:18.850417 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d7d4d-6315-4bf3-add9-7d72d7784d17 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:18.852174 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 106/213] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:18.857667 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7d4d-6315-4bf3-add9-7d72d7784d17 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:18.867378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:18.891829 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb11ec4-06bf-4e9d-88cf-47d870f02ccc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:18.931066 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb383b4a-45ed-46e2-abe3-29d5f038f027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:18.932222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb383b4a-45ed-46e2-abe3-29d5f038f027 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:18.932754 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb383b4a-45ed-46e2-abe3-29d5f038f027 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:18.933231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb383b4a-45ed-46e2-abe3-29d5f038f027 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:18.944710 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb383b4a-45ed-46e2-abe3-29d5f038f027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-bb383b4a-45ed-46e2-abe3-29d5f038f027 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:18.949929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:18.950854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:18.951659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:18.954133 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 108/214] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:18.955541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:18.966134 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7d4d-6315-4bf3-add9-7d72d7784d17 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:18.969221 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb383b4a-45ed-46e2-abe3-29d5f038f027 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:19.001954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c468085-e5d3-4256-8634-8c3c6628011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:19.002582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c468085-e5d3-4256-8634-8c3c6628011f None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:19.002856 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c468085-e5d3-4256-8634-8c3c6628011f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:19.003120 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c468085-e5d3-4256-8634-8c3c6628011f None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:19.003766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c468085-e5d3-4256-8634-8c3c6628011f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:19.005692 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c468085-e5d3-4256-8634-8c3c6628011f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:19.079814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb383b4a-45ed-46e2-abe3-29d5f038f027 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:19.090553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 107/215] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:11:18 2022] POST /identity/v3/users => generated 297 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:19.090553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b921ec-8074-4178-a4d5-9a501452439c None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:19.090553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b921ec-8074-4178-a4d5-9a501452439c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:19.090553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b921ec-8074-4178-a4d5-9a501452439c None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:19.090553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 108/216] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:19.096253 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d8e01-7eaa-4ed5-9ed7-94eac35e29a3 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:19.096998 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d8e01-7eaa-4ed5-9ed7-94eac35e29a3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:19.097464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d8e01-7eaa-4ed5-9ed7-94eac35e29a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:19.119775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b04d8e01-7eaa-4ed5-9ed7-94eac35e29a3 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:19.121435 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b04d8e01-7eaa-4ed5-9ed7-94eac35e29a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:19.129487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acfbe3-608e-4672-a2bd-f8785ccc0025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:19.130388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acfbe3-608e-4672-a2bd-f8785ccc0025 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:19.130685 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acfbe3-608e-4672-a2bd-f8785ccc0025 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:19.130996 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acfbe3-608e-4672-a2bd-f8785ccc0025 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:19.132397 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acfbe3-608e-4672-a2bd-f8785ccc0025 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:19.132774 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acfbe3-608e-4672-a2bd-f8785ccc0025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:19.134329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acfbe3-608e-4672-a2bd-f8785ccc0025 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:19.137957 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:19.150225 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 109/217] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:19.155825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acfbe3-608e-4672-a2bd-f8785ccc0025 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:19.209943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 109/218] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:19.280574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acfbe3-608e-4672-a2bd-f8785ccc0025 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:19.315555 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ebdcc-a856-45ad-a46b-99bd0078e7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:19.316981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ebdcc-a856-45ad-a46b-99bd0078e7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:19.318230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ebdcc-a856-45ad-a46b-99bd0078e7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:19.318838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ebdcc-a856-45ad-a46b-99bd0078e7e7 None admin] PATH_INFO: `/v3/users/3dbdf66d4e624a7191d718e76e973bb6` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:19.334908 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ebdcc-a856-45ad-a46b-99bd0078e7e7 None admin] RBAC: Authorizing `identity:get_user(user_id=3dbdf66d4e624a7191d718e76e973bb6)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:19.336694 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784ebdcc-a856-45ad-a46b-99bd0078e7e7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:19.338603 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 110/219] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:19 2022] GET /identity/v3/users/3dbdf66d4e624a7191d718e76e973bb6 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:19.344759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d8e01-7eaa-4ed5-9ed7-94eac35e29a3 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:19.371532 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0063090-249b-4990-99fb-79962848c229 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:19.371713 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0063090-249b-4990-99fb-79962848c229 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:19.371978 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0063090-249b-4990-99fb-79962848c229 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:19.373312 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 111/220] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:19.381723 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0a763-aff0-464e-aa92-9a4efc1ae024 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:19.381996 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0a763-aff0-464e-aa92-9a4efc1ae024 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:19.382305 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b0a763-aff0-464e-aa92-9a4efc1ae024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:19.407283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-a6b0a763-aff0-464e-aa92-9a4efc1ae024 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:19.408461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-a6b0a763-aff0-464e-aa92-9a4efc1ae024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:19.431669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:19.477806 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:19.488638 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d8e01-7eaa-4ed5-9ed7-94eac35e29a3 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:19.497006 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 112/221] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:19.501576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0a763-aff0-464e-aa92-9a4efc1ae024 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:19.529941 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dc396-0ba2-4efc-adbf-5d019e15ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:19.530599 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dc396-0ba2-4efc-adbf-5d019e15ba23 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:19.530879 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dc396-0ba2-4efc-adbf-5d019e15ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:19.531150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dc396-0ba2-4efc-adbf-5d019e15ba23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:19.616191 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dc396-0ba2-4efc-adbf-5d019e15ba23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:19.617811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dc396-0ba2-4efc-adbf-5d019e15ba23 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:19.633447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b0a763-aff0-464e-aa92-9a4efc1ae024 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:19.669399 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887cfb2-bd4f-4622-b4ba-0fd3c3681417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:19.670541 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887cfb2-bd4f-4622-b4ba-0fd3c3681417 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:19.671309 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887cfb2-bd4f-4622-b4ba-0fd3c3681417 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:19.671974 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887cfb2-bd4f-4622-b4ba-0fd3c3681417 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:19.684502 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:19.686792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887cfb2-bd4f-4622-b4ba-0fd3c3681417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-5887cfb2-bd4f-4622-b4ba-0fd3c3681417 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:19.691686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:19.693482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:19.702204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 113/222] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:19.704041 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887cfb2-bd4f-4622-b4ba-0fd3c3681417 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:19.732780 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 110/223] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:19.738473 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dc396-0ba2-4efc-adbf-5d019e15ba23 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:19.829355 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:19.841721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dc396-0ba2-4efc-adbf-5d019e15ba23 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:19.880803 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdecbba-4c2c-4225-a75e-f30525ef8097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:19.881582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdecbba-4c2c-4225-a75e-f30525ef8097 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:19.882015 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdecbba-4c2c-4225-a75e-f30525ef8097 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:19.882382 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdecbba-4c2c-4225-a75e-f30525ef8097 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:19.883674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdecbba-4c2c-4225-a75e-f30525ef8097 None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:19.885283 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdecbba-4c2c-4225-a75e-f30525ef8097 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:19.887029 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 111/224] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:19 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:19.887868 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdecbba-4c2c-4225-a75e-f30525ef8097 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:19.898288 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887cfb2-bd4f-4622-b4ba-0fd3c3681417 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:19.927187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:19.933669 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312898a-860a-49d0-85c7-6fa50c68ba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:19.934313 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312898a-860a-49d0-85c7-6fa50c68ba4a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:19.934594 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312898a-860a-49d0-85c7-6fa50c68ba4a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:19.934867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312898a-860a-49d0-85c7-6fa50c68ba4a None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:19.935538 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312898a-860a-49d0-85c7-6fa50c68ba4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:19.935839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312898a-860a-49d0-85c7-6fa50c68ba4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:19.937218 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312898a-860a-49d0-85c7-6fa50c68ba4a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:19.947047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 114/225] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:19.947895 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312898a-860a-49d0-85c7-6fa50c68ba4a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:20.008500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdecbba-4c2c-4225-a75e-f30525ef8097 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:20.045277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e74c1-e111-47e1-bc6a-f23b57641587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:20.046085 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e74c1-e111-47e1-bc6a-f23b57641587 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:20.046471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e74c1-e111-47e1-bc6a-f23b57641587 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:20.046812 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e74c1-e111-47e1-bc6a-f23b57641587 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:20.051272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312898a-860a-49d0-85c7-6fa50c68ba4a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:20.058340 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e74c1-e111-47e1-bc6a-f23b57641587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:20.059061 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-190e74c1-e111-47e1-bc6a-f23b57641587 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:20.064492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:20.065628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:20.066462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:20.069221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 112/226] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:20.070210 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e74c1-e111-47e1-bc6a-f23b57641587 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:20.087087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f525d18-e749-4835-98ae-905d0e3be945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:20.088068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525d18-e749-4835-98ae-905d0e3be945 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:20.088358 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525d18-e749-4835-98ae-905d0e3be945 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:20.088637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f525d18-e749-4835-98ae-905d0e3be945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:20.089528 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f525d18-e749-4835-98ae-905d0e3be945 None admin] RBAC: Adding query filter params (role.id=550a417973df4feda528c3e0787c1619, scope.project.id=bc5ad8f68599461690aa33f7d63a0536, user.id=3dbdf66d4e624a7191d718e76e973bb6) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:20.089943 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f525d18-e749-4835-98ae-905d0e3be945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:20.091580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f525d18-e749-4835-98ae-905d0e3be945 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:20.105037 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 115/227] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:19 2022] GET /identity/v3/role_assignments?user.id=3dbdf66d4e624a7191d718e76e973bb6&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=550a417973df4feda528c3e0787c1619 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:20.105037 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f525d18-e749-4835-98ae-905d0e3be945 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:20.223321 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f525d18-e749-4835-98ae-905d0e3be945 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:20.261996 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e74c1-e111-47e1-bc6a-f23b57641587 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:20.290492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:20.303028 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65691ebb-e2a8-4339-8fa6-9eb9ed9c19b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:20.303799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691ebb-e2a8-4339-8fa6-9eb9ed9c19b8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:20.304193 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691ebb-e2a8-4339-8fa6-9eb9ed9c19b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:20.304480 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65691ebb-e2a8-4339-8fa6-9eb9ed9c19b8 None admin] PATH_INFO: `/v3/users/c68d73c83ca8481c81b8a54779ac6979` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:20.305855 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65691ebb-e2a8-4339-8fa6-9eb9ed9c19b8 None admin] RBAC: Authorizing `identity:get_user(user_id=c68d73c83ca8481c81b8a54779ac6979)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:20.311688 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65691ebb-e2a8-4339-8fa6-9eb9ed9c19b8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:20.312588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556de5dc-e5f2-4da6-8621-f2523456caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:20.313314 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556de5dc-e5f2-4da6-8621-f2523456caee None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:20.313691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556de5dc-e5f2-4da6-8621-f2523456caee None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:20.315731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 113/228] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:20 2022] GET /identity/v3/users/c68d73c83ca8481c81b8a54779ac6979 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:20.315984 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556de5dc-e5f2-4da6-8621-f2523456caee None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:20.324168 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556de5dc-e5f2-4da6-8621-f2523456caee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:20.324168 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556de5dc-e5f2-4da6-8621-f2523456caee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:20.324168 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556de5dc-e5f2-4da6-8621-f2523456caee None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:20.328089 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65691ebb-e2a8-4339-8fa6-9eb9ed9c19b8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:20.341709 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 116/229] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:20.349053 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556de5dc-e5f2-4da6-8621-f2523456caee None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:20.449765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:20.472149 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65691ebb-e2a8-4339-8fa6-9eb9ed9c19b8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:20.533395 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49cce4-d640-422e-8ea0-de85218453de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:20.534162 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49cce4-d640-422e-8ea0-de85218453de None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:20.534562 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49cce4-d640-422e-8ea0-de85218453de None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:20.534931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49cce4-d640-422e-8ea0-de85218453de None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:20.537583 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49cce4-d640-422e-8ea0-de85218453de None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:20.539339 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49cce4-d640-422e-8ea0-de85218453de None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:20.541756 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 114/230] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:20 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:20.547065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556de5dc-e5f2-4da6-8621-f2523456caee None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:20.547758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49cce4-d640-422e-8ea0-de85218453de None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:20.612783 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:20.639953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c516-6ddf-4528-a064-e06e75e68c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:20.640763 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c516-6ddf-4528-a064-e06e75e68c4a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:20.641175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c516-6ddf-4528-a064-e06e75e68c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:20.641548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188c516-6ddf-4528-a064-e06e75e68c4a None admin] PATH_INFO: `/v3/users/c68d73c83ca8481c81b8a54779ac6979` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:20.643226 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188c516-6ddf-4528-a064-e06e75e68c4a None admin] RBAC: Authorizing `identity:get_user(user_id=c68d73c83ca8481c81b8a54779ac6979)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:20.645545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188c516-6ddf-4528-a064-e06e75e68c4a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:20.647343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 117/231] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:20 2022] GET /identity/v3/users/c68d73c83ca8481c81b8a54779ac6979 => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:20.653244 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c516-6ddf-4528-a064-e06e75e68c4a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:20.793379 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49cce4-d640-422e-8ea0-de85218453de None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:20.816046 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:20.819959 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188c516-6ddf-4528-a064-e06e75e68c4a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:20.870660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51e5e9-07d6-42d1-8318-f73bf0e71876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:20.871305 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51e5e9-07d6-42d1-8318-f73bf0e71876 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:20.871588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51e5e9-07d6-42d1-8318-f73bf0e71876 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:20.871861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51e5e9-07d6-42d1-8318-f73bf0e71876 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:20.873999 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51e5e9-07d6-42d1-8318-f73bf0e71876 None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:20.875480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51e5e9-07d6-42d1-8318-f73bf0e71876 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:20.877143 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 118/232] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:20 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:20.883052 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10b8d6-45ac-4f8d-8be3-79a5a0f3c444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:20.883875 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51e5e9-07d6-42d1-8318-f73bf0e71876 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:20.884540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10b8d6-45ac-4f8d-8be3-79a5a0f3c444 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:20.885010 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10b8d6-45ac-4f8d-8be3-79a5a0f3c444 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:20.885770 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10b8d6-45ac-4f8d-8be3-79a5a0f3c444 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536/users/c68d73c83ca8481c81b8a54779ac6979/roles/afe88bc03d30494b89892587177c79de` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:20.888411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10b8d6-45ac-4f8d-8be3-79a5a0f3c444 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc5ad8f68599461690aa33f7d63a0536, user_id=c68d73c83ca8481c81b8a54779ac6979, role_id=afe88bc03d30494b89892587177c79de)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:20.892151 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10b8d6-45ac-4f8d-8be3-79a5a0f3c444 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:20.992595 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 115/233] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:11:20 2022] PUT /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536/users/c68d73c83ca8481c81b8a54779ac6979/roles/afe88bc03d30494b89892587177c79de => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 07:11:21.043834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51e5e9-07d6-42d1-8318-f73bf0e71876 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:21.096069 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409703dd-5797-473e-8731-812c5945f030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:21.097114 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409703dd-5797-473e-8731-812c5945f030 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:21.097585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409703dd-5797-473e-8731-812c5945f030 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:21.098048 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409703dd-5797-473e-8731-812c5945f030 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536/users/c68d73c83ca8481c81b8a54779ac6979/roles/adc491d8d49c47779e572883af3ed47e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:21.101528 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409703dd-5797-473e-8731-812c5945f030 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc5ad8f68599461690aa33f7d63a0536, user_id=c68d73c83ca8481c81b8a54779ac6979, role_id=adc491d8d49c47779e572883af3ed47e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:21.104019 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409703dd-5797-473e-8731-812c5945f030 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:21.188690 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 119/234] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:11:20 2022] PUT /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536/users/c68d73c83ca8481c81b8a54779ac6979/roles/adc491d8d49c47779e572883af3ed47e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:21.578935 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf32193-8b38-4e60-9d13-04b7f0c71766 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:21.579285 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf32193-8b38-4e60-9d13-04b7f0c71766 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:21.579483 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf32193-8b38-4e60-9d13-04b7f0c71766 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:21.581105 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 116/235] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:21.586973 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f18ce-0b84-4753-897a-001a1bf8b082 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:21.587399 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f18ce-0b84-4753-897a-001a1bf8b082 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:21.587568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f18ce-0b84-4753-897a-001a1bf8b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:21.619129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-ba4f18ce-0b84-4753-897a-001a1bf8b082 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:21.620337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-ba4f18ce-0b84-4753-897a-001a1bf8b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:21.661108 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:21.718355 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 120/236] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:21.736770 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cdb07-496c-40bc-9eef-27d2dee23a47 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:21.737201 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cdb07-496c-40bc-9eef-27d2dee23a47 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:21.737571 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cdb07-496c-40bc-9eef-27d2dee23a47 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:21.740509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 117/237] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:21.745092 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d53ffd-89cf-488b-b0b8-644c5f3f907c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:21.745391 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d53ffd-89cf-488b-b0b8-644c5f3f907c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:21.745666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d53ffd-89cf-488b-b0b8-644c5f3f907c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:21.764435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-37d53ffd-89cf-488b-b0b8-644c5f3f907c None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:21.765612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-37d53ffd-89cf-488b-b0b8-644c5f3f907c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:21.842439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 121/238] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:22.056095 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cdb07-496c-40bc-9eef-27d2dee23a47 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:22.148182 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:22.161222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cdb07-496c-40bc-9eef-27d2dee23a47 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:22.184419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d53ffd-89cf-488b-b0b8-644c5f3f907c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:22.199838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea29e13-2212-47b6-a2da-9aca0241702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:22.200478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea29e13-2212-47b6-a2da-9aca0241702d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:22.200760 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea29e13-2212-47b6-a2da-9aca0241702d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:22.201045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea29e13-2212-47b6-a2da-9aca0241702d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:22.214252 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea29e13-2212-47b6-a2da-9aca0241702d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3ea29e13-2212-47b6-a2da-9aca0241702d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:22.221155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:22.222008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:22.222807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:22.226533 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 118/239] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:22.229550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea29e13-2212-47b6-a2da-9aca0241702d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:22.306497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:22.316501 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d53ffd-89cf-488b-b0b8-644c5f3f907c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:22.353833 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e7e07-d5b1-4830-9ec4-cfbed115015f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:22.354654 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e7e07-d5b1-4830-9ec4-cfbed115015f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:22.354939 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e7e07-d5b1-4830-9ec4-cfbed115015f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:22.355224 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e7e07-d5b1-4830-9ec4-cfbed115015f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:22.356324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e7e07-d5b1-4830-9ec4-cfbed115015f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:22.358214 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e7e07-d5b1-4830-9ec4-cfbed115015f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:22.359938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 122/240] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:22.366024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e7e07-d5b1-4830-9ec4-cfbed115015f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:22.455656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea29e13-2212-47b6-a2da-9aca0241702d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:22.495555 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec444c69-821b-41d0-afd7-454cbed8b1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:22.496174 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec444c69-821b-41d0-afd7-454cbed8b1a9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:22.496453 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec444c69-821b-41d0-afd7-454cbed8b1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:22.496720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec444c69-821b-41d0-afd7-454cbed8b1a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:22.497386 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec444c69-821b-41d0-afd7-454cbed8b1a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:22.497683 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec444c69-821b-41d0-afd7-454cbed8b1a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:22.499259 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec444c69-821b-41d0-afd7-454cbed8b1a9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:22.508489 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 119/241] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:22.514512 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec444c69-821b-41d0-afd7-454cbed8b1a9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:22.529050 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:22.569835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e7e07-d5b1-4830-9ec4-cfbed115015f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:22.619828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8204e3-d69c-4677-b704-47d7cd39c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:22.620568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8204e3-d69c-4677-b704-47d7cd39c7d1 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:22.620831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8204e3-d69c-4677-b704-47d7cd39c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:22.621156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8204e3-d69c-4677-b704-47d7cd39c7d1 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:22.621808 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8204e3-d69c-4677-b704-47d7cd39c7d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:22.623443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8204e3-d69c-4677-b704-47d7cd39c7d1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:22.648429 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec444c69-821b-41d0-afd7-454cbed8b1a9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:22.683937 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1ce71-0c43-4f89-8993-e30ba83fe01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:22.684542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1ce71-0c43-4f89-8993-e30ba83fe01b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:22.684802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1ce71-0c43-4f89-8993-e30ba83fe01b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:22.685124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1ce71-0c43-4f89-8993-e30ba83fe01b None admin] PATH_INFO: `/v3/users/d3dc2fc8bea54f17bd4c183742fe9ed7` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:22.699387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1ce71-0c43-4f89-8993-e30ba83fe01b None admin] RBAC: Authorizing `identity:get_user(user_id=d3dc2fc8bea54f17bd4c183742fe9ed7)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:22.700852 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1ce71-0c43-4f89-8993-e30ba83fe01b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:22.702658 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 120/242] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:22 2022] GET /identity/v3/users/d3dc2fc8bea54f17bd4c183742fe9ed7 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:22.706465 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4336d4-b2a8-48dd-8fee-7603f26b25c0 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:22.706465 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4336d4-b2a8-48dd-8fee-7603f26b25c0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:22.706465 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4336d4-b2a8-48dd-8fee-7603f26b25c0 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:22.706465 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 121/243] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:22.712596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4336d4-b2a8-48dd-8fee-7603f26b25c0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:22.718018 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 123/244] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:11:22 2022] POST /identity/v3/users => generated 293 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:22.720663 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef607-5e95-4aee-899d-b330a897f086 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:22.721057 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef607-5e95-4aee-899d-b330a897f086 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:22.730470 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaef607-5e95-4aee-899d-b330a897f086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:22.750014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5eaef607-5e95-4aee-899d-b330a897f086 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:22.751415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5eaef607-5e95-4aee-899d-b330a897f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:22.768756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:22.870734 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:22.888843 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 124/245] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:22.939537 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4336d4-b2a8-48dd-8fee-7603f26b25c0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:22.978169 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cbcbd-a333-471b-a73a-8f20f633d2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:22.978698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cbcbd-a333-471b-a73a-8f20f633d2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:22.978980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cbcbd-a333-471b-a73a-8f20f633d2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:22.979251 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cbcbd-a333-471b-a73a-8f20f633d2a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:23.053016 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cbcbd-a333-471b-a73a-8f20f633d2a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:23.054520 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cbcbd-a333-471b-a73a-8f20f633d2a0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:23.128410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:23.177690 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 122/246] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:23.179289 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaef607-5e95-4aee-899d-b330a897f086 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:23.248554 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cbcbd-a333-471b-a73a-8f20f633d2a0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:23.289775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaef607-5e95-4aee-899d-b330a897f086 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:23.341386 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a458c-1469-42f7-b55a-aac41b525ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:23.342301 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a458c-1469-42f7-b55a-aac41b525ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:23.342829 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a458c-1469-42f7-b55a-aac41b525ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:23.343491 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a458c-1469-42f7-b55a-aac41b525ee8 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:23.344955 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a458c-1469-42f7-b55a-aac41b525ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:23.346667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a458c-1469-42f7-b55a-aac41b525ee8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:23.348497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 125/247] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:23 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:23.354793 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a458c-1469-42f7-b55a-aac41b525ee8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:23.371204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:23.371478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cbcbd-a333-471b-a73a-8f20f633d2a0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:23.412519 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fbb74-cf09-4341-b525-04c077503a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:23.413156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fbb74-cf09-4341-b525-04c077503a86 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:23.413488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fbb74-cf09-4341-b525-04c077503a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:23.413768 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42fbb74-cf09-4341-b525-04c077503a86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:23.436803 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42fbb74-cf09-4341-b525-04c077503a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a42fbb74-cf09-4341-b525-04c077503a86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:23.443336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:23.444219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:23.445466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 123/248] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:23.455467 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fbb74-cf09-4341-b525-04c077503a86 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:23.496601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a458c-1469-42f7-b55a-aac41b525ee8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:23.500806 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:23.545250 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451437d-1dc9-4be2-b94f-a00d5e759ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:23.545871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451437d-1dc9-4be2-b94f-a00d5e759ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:23.546173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451437d-1dc9-4be2-b94f-a00d5e759ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:23.546453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451437d-1dc9-4be2-b94f-a00d5e759ff3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:23.547266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451437d-1dc9-4be2-b94f-a00d5e759ff3 None admin] RBAC: Adding query filter params (role.id=32087f94c45f41e3bee5e95eda599d6f, scope.project.id=bc5ad8f68599461690aa33f7d63a0536, user.id=d3dc2fc8bea54f17bd4c183742fe9ed7) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:23.547577 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451437d-1dc9-4be2-b94f-a00d5e759ff3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:23.553777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451437d-1dc9-4be2-b94f-a00d5e759ff3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:23.564914 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 126/249] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:23 2022] GET /identity/v3/role_assignments?user.id=d3dc2fc8bea54f17bd4c183742fe9ed7&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=32087f94c45f41e3bee5e95eda599d6f => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:23.566398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea8bb6-fe18-4469-99f8-f56c240bf755 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:23.566681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea8bb6-fe18-4469-99f8-f56c240bf755 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:23.567704 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea8bb6-fe18-4469-99f8-f56c240bf755 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:23.569180 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 127/250] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:23.575840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88cb1-b230-4984-a3bf-88475d384ce5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:23.576127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88cb1-b230-4984-a3bf-88475d384ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:23.576410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88cb1-b230-4984-a3bf-88475d384ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:23.604147 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42fbb74-cf09-4341-b525-04c077503a86 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:23.616441 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-41b88cb1-b230-4984-a3bf-88475d384ce5 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:23.617566 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-41b88cb1-b230-4984-a3bf-88475d384ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:23.646862 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4829fc6-62a2-4205-bb44-05517d6c801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:23.647719 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4829fc6-62a2-4205-bb44-05517d6c801d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:23.648141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4829fc6-62a2-4205-bb44-05517d6c801d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:23.648550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4829fc6-62a2-4205-bb44-05517d6c801d None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:23.649368 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4829fc6-62a2-4205-bb44-05517d6c801d None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:23.649836 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4829fc6-62a2-4205-bb44-05517d6c801d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:23.652161 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4829fc6-62a2-4205-bb44-05517d6c801d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:23.663811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 124/251] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:23.671431 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4829fc6-62a2-4205-bb44-05517d6c801d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:23.759004 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 128/252] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:23.760282 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39d15-800f-4834-9511-853dae73133d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:23.760566 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39d15-800f-4834-9511-853dae73133d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:23.760835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f39d15-800f-4834-9511-853dae73133d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:23.763140 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 129/253] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:23.768950 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb271e7-ee11-4d7e-9b83-c856e1236e34 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:23.769243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb271e7-ee11-4d7e-9b83-c856e1236e34 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:23.769502 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb271e7-ee11-4d7e-9b83-c856e1236e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:23.777591 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:23.802279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bcb271e7-ee11-4d7e-9b83-c856e1236e34 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:23.803503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bcb271e7-ee11-4d7e-9b83-c856e1236e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:23.840374 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:23.851885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4829fc6-62a2-4205-bb44-05517d6c801d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:23.888771 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6549eab-4cd1-4273-afc7-9110248d6d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:23.889644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6549eab-4cd1-4273-afc7-9110248d6d38 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:23.890094 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6549eab-4cd1-4273-afc7-9110248d6d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:23.890538 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6549eab-4cd1-4273-afc7-9110248d6d38 None admin] PATH_INFO: `/v3/users/3dbdf66d4e624a7191d718e76e973bb6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:23.891858 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6549eab-4cd1-4273-afc7-9110248d6d38 None admin] RBAC: Authorizing `identity:get_user(user_id=3dbdf66d4e624a7191d718e76e973bb6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:23.893509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6549eab-4cd1-4273-afc7-9110248d6d38 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:23.895445 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 125/254] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:23 2022] GET /identity/v3/users/3dbdf66d4e624a7191d718e76e973bb6 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:23.903304 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6549eab-4cd1-4273-afc7-9110248d6d38 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:23.929518 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 130/255] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:24.029554 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6549eab-4cd1-4273-afc7-9110248d6d38 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:24.066015 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696babe-1096-4b4e-ae6c-c16f70cdcfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:24.066934 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696babe-1096-4b4e-ae6c-c16f70cdcfaf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:24.067355 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696babe-1096-4b4e-ae6c-c16f70cdcfaf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:24.067766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696babe-1096-4b4e-ae6c-c16f70cdcfaf None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:24.069056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696babe-1096-4b4e-ae6c-c16f70cdcfaf None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:24.070692 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696babe-1096-4b4e-ae6c-c16f70cdcfaf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:24.072464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 126/256] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:23 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:24.078235 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb271e7-ee11-4d7e-9b83-c856e1236e34 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:24.223617 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb271e7-ee11-4d7e-9b83-c856e1236e34 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:24.267843 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6704b1d-be50-4c0c-a57b-3eca7bba6fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:24.268508 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6704b1d-be50-4c0c-a57b-3eca7bba6fcc None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:24.268784 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6704b1d-be50-4c0c-a57b-3eca7bba6fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:24.269052 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6704b1d-be50-4c0c-a57b-3eca7bba6fcc None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536/users/3dbdf66d4e624a7191d718e76e973bb6/roles/550a417973df4feda528c3e0787c1619` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:24.274841 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6704b1d-be50-4c0c-a57b-3eca7bba6fcc None admin] RBAC: Authorizing `identity:create_grant(project_id=bc5ad8f68599461690aa33f7d63a0536, user_id=3dbdf66d4e624a7191d718e76e973bb6, role_id=550a417973df4feda528c3e0787c1619)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:24.276359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6704b1d-be50-4c0c-a57b-3eca7bba6fcc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:24.276940 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696babe-1096-4b4e-ae6c-c16f70cdcfaf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:24.282443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:24.321055 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:24.371219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 131/257] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:11:24 2022] PUT /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536/users/3dbdf66d4e624a7191d718e76e973bb6/roles/550a417973df4feda528c3e0787c1619 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:24.372159 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6704b1d-be50-4c0c-a57b-3eca7bba6fcc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:24.401866 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696babe-1096-4b4e-ae6c-c16f70cdcfaf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:24.448807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75911008-c819-4259-80a1-539b2c1b6b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:24.449452 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75911008-c819-4259-80a1-539b2c1b6b72 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:24.449730 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75911008-c819-4259-80a1-539b2c1b6b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:24.450005 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75911008-c819-4259-80a1-539b2c1b6b72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:24.483045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75911008-c819-4259-80a1-539b2c1b6b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-75911008-c819-4259-80a1-539b2c1b6b72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:24.488706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:24.489592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:24.490541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:24.492871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 127/258] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:11:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:24.505937 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75911008-c819-4259-80a1-539b2c1b6b72 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:24.569738 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6704b1d-be50-4c0c-a57b-3eca7bba6fcc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:24.640651 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c1813-09dd-4f9f-98e7-b576210eac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:24.641298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1813-09dd-4f9f-98e7-b576210eac2b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:24.641580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1813-09dd-4f9f-98e7-b576210eac2b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:24.641853 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c1813-09dd-4f9f-98e7-b576210eac2b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:24.663163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c1813-09dd-4f9f-98e7-b576210eac2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-580c1813-09dd-4f9f-98e7-b576210eac2b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:24.668701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:24.669606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:24.670848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 132/259] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:24.677940 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c1813-09dd-4f9f-98e7-b576210eac2b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:24.694509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:24.740080 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75911008-c819-4259-80a1-539b2c1b6b72 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:24.771972 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:24.822878 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c1813-09dd-4f9f-98e7-b576210eac2b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:24.830794 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70295387-6b47-45ab-9950-672f07a3d399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:24.831481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295387-6b47-45ab-9950-672f07a3d399 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:24.831768 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295387-6b47-45ab-9950-672f07a3d399 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:24.832044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70295387-6b47-45ab-9950-672f07a3d399 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:24.833389 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70295387-6b47-45ab-9950-672f07a3d399 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:24.833692 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70295387-6b47-45ab-9950-672f07a3d399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:24.835119 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70295387-6b47-45ab-9950-672f07a3d399 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:24.852562 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 128/260] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:24.857674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70295387-6b47-45ab-9950-672f07a3d399 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:24.871080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d316945-d3e6-42a0-a26d-4b98c3dfdf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:24.871699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d316945-d3e6-42a0-a26d-4b98c3dfdf25 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:24.871976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d316945-d3e6-42a0-a26d-4b98c3dfdf25 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:24.872245 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d316945-d3e6-42a0-a26d-4b98c3dfdf25 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:24.872906 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d316945-d3e6-42a0-a26d-4b98c3dfdf25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:24.873208 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d316945-d3e6-42a0-a26d-4b98c3dfdf25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:24.874594 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d316945-d3e6-42a0-a26d-4b98c3dfdf25 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:24.891743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 133/261] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:24.898708 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d316945-d3e6-42a0-a26d-4b98c3dfdf25 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:25.036022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d316945-d3e6-42a0-a26d-4b98c3dfdf25 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:25.070455 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:25.130234 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddcd48-42a2-4434-a27b-b9f4f5026f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:25.130807 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddcd48-42a2-4434-a27b-b9f4f5026f0c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:25.131093 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddcd48-42a2-4434-a27b-b9f4f5026f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:25.131366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaddcd48-42a2-4434-a27b-b9f4f5026f0c None admin] PATH_INFO: `/v3/users/c68d73c83ca8481c81b8a54779ac6979` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:25.132597 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddcd48-42a2-4434-a27b-b9f4f5026f0c None admin] RBAC: Authorizing `identity:get_user(user_id=c68d73c83ca8481c81b8a54779ac6979)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:25.134056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaddcd48-42a2-4434-a27b-b9f4f5026f0c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:25.136006 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 134/262] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:24 2022] GET /identity/v3/users/c68d73c83ca8481c81b8a54779ac6979 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:25.141941 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddcd48-42a2-4434-a27b-b9f4f5026f0c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:25.170679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70295387-6b47-45ab-9950-672f07a3d399 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:25.274849 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208aa5d3-0d93-4906-a8e8-fd3ff8ae55f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:25.275506 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208aa5d3-0d93-4906-a8e8-fd3ff8ae55f7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:25.275792 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208aa5d3-0d93-4906-a8e8-fd3ff8ae55f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:25.276069 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208aa5d3-0d93-4906-a8e8-fd3ff8ae55f7 None admin] PATH_INFO: `/v3/users/c68d73c83ca8481c81b8a54779ac6979` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:25.277277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208aa5d3-0d93-4906-a8e8-fd3ff8ae55f7 None admin] RBAC: Authorizing `identity:get_user(user_id=c68d73c83ca8481c81b8a54779ac6979)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:25.278821 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208aa5d3-0d93-4906-a8e8-fd3ff8ae55f7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:25.280737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 129/263] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:24 2022] GET /identity/v3/users/c68d73c83ca8481c81b8a54779ac6979 => generated 283 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:25.286199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208aa5d3-0d93-4906-a8e8-fd3ff8ae55f7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:25.331108 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaddcd48-42a2-4434-a27b-b9f4f5026f0c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:25.344172 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:25.390355 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b77074-4e70-465c-bf32-c99992fbc72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:25.390969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b77074-4e70-465c-bf32-c99992fbc72a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:25.391241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b77074-4e70-465c-bf32-c99992fbc72a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:25.391510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b77074-4e70-465c-bf32-c99992fbc72a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:25.482769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:25.515871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b77074-4e70-465c-bf32-c99992fbc72a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:25.518086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b77074-4e70-465c-bf32-c99992fbc72a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:25.550231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208aa5d3-0d93-4906-a8e8-fd3ff8ae55f7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:25.625991 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7304510-8b16-4c7c-8876-35a575e8aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:25.626962 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7304510-8b16-4c7c-8876-35a575e8aabc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:25.627441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7304510-8b16-4c7c-8876-35a575e8aabc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:25.627933 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7304510-8b16-4c7c-8876-35a575e8aabc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:25.769209 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 135/264] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:25.775902 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b77074-4e70-465c-bf32-c99992fbc72a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:25.808057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7304510-8b16-4c7c-8876-35a575e8aabc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:25.809926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7304510-8b16-4c7c-8876-35a575e8aabc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:25.850457 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:25.964811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:25.991777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b77074-4e70-465c-bf32-c99992fbc72a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:26.018254 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 130/265] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 07:11:26.019626 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afbab7-1a03-4ea6-aee4-c2589e2e4caf None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:26.019957 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afbab7-1a03-4ea6-aee4-c2589e2e4caf None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:26.025823 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afbab7-1a03-4ea6-aee4-c2589e2e4caf None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:26.027393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 131/266] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:26.029352 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afbab7-1a03-4ea6-aee4-c2589e2e4caf None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:26.055558 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376826c9-28b4-44b9-8b70-b9dc63520f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:26.056208 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376826c9-28b4-44b9-8b70-b9dc63520f5f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:26.056484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376826c9-28b4-44b9-8b70-b9dc63520f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:26.056753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376826c9-28b4-44b9-8b70-b9dc63520f5f None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:26.059354 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376826c9-28b4-44b9-8b70-b9dc63520f5f None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:26.060804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376826c9-28b4-44b9-8b70-b9dc63520f5f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:26.062670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 136/267] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:25 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:26.063575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b58a54-1596-4be8-9c10-565872c37942 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:26.063856 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b58a54-1596-4be8-9c10-565872c37942 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:26.064241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b58a54-1596-4be8-9c10-565872c37942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:26.105437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-15b58a54-1596-4be8-9c10-565872c37942 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:26.106687 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-15b58a54-1596-4be8-9c10-565872c37942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:26.219130 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afbab7-1a03-4ea6-aee4-c2589e2e4caf None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:26.230906 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 137/268] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:26.232545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b58a54-1596-4be8-9c10-565872c37942 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:26.248452 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:26.281419 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac668e-494e-4844-8bb0-2e663988541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:26.282014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac668e-494e-4844-8bb0-2e663988541c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:26.282259 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac668e-494e-4844-8bb0-2e663988541c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:26.282533 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac668e-494e-4844-8bb0-2e663988541c None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:26.283740 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac668e-494e-4844-8bb0-2e663988541c None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:26.286360 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac668e-494e-4844-8bb0-2e663988541c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:26.288011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 132/269] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:26 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:26.289127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44853a-8dc1-4494-96f7-284bb87297ca None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:26.289404 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44853a-8dc1-4494-96f7-284bb87297ca None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:26.289674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44853a-8dc1-4494-96f7-284bb87297ca None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:26.294266 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 133/270] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:26.295187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44853a-8dc1-4494-96f7-284bb87297ca None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:26.378562 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:26.424022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b58a54-1596-4be8-9c10-565872c37942 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:26.450382 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44853a-8dc1-4494-96f7-284bb87297ca None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:26.486694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389d066-e304-420d-89db-090a7e3f73d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:26.487303 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389d066-e304-420d-89db-090a7e3f73d6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:26.487587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389d066-e304-420d-89db-090a7e3f73d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:26.487862 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389d066-e304-420d-89db-090a7e3f73d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:26.489114 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389d066-e304-420d-89db-090a7e3f73d6 None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=bc5ad8f68599461690aa33f7d63a0536, user.id=c68d73c83ca8481c81b8a54779ac6979) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:26.489426 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389d066-e304-420d-89db-090a7e3f73d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:26.490897 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389d066-e304-420d-89db-090a7e3f73d6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:26.497601 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 134/271] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:26 2022] GET /identity/v3/role_assignments?user.id=c68d73c83ca8481c81b8a54779ac6979&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=afe88bc03d30494b89892587177c79de => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:26.498703 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488584ac-416b-4c94-980c-53a908c95ba0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:26.498985 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488584ac-416b-4c94-980c-53a908c95ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:26.499260 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488584ac-416b-4c94-980c-53a908c95ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:26.518831 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-488584ac-416b-4c94-980c-53a908c95ba0 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:26.520368 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-488584ac-416b-4c94-980c-53a908c95ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:26.534286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a54e8-c994-4afb-93ea-249adddb9df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:26.534836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a54e8-c994-4afb-93ea-249adddb9df7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:26.535114 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a54e8-c994-4afb-93ea-249adddb9df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:26.535473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a54e8-c994-4afb-93ea-249adddb9df7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:26.536221 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a54e8-c994-4afb-93ea-249adddb9df7 None admin] RBAC: Adding query filter params (role.id=adc491d8d49c47779e572883af3ed47e, scope.project.id=bc5ad8f68599461690aa33f7d63a0536, user.id=c68d73c83ca8481c81b8a54779ac6979) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:26.536530 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a54e8-c994-4afb-93ea-249adddb9df7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:26.538010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a54e8-c994-4afb-93ea-249adddb9df7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:26.544634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 138/272] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:26 2022] GET /identity/v3/role_assignments?user.id=c68d73c83ca8481c81b8a54779ac6979&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=adc491d8d49c47779e572883af3ed47e => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:26.552232 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78b7eb-4b3b-423d-a580-6b551b5a0b5b None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:26.552560 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78b7eb-4b3b-423d-a580-6b551b5a0b5b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:26.552787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78b7eb-4b3b-423d-a580-6b551b5a0b5b None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:26.559065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 139/273] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:26.560056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78b7eb-4b3b-423d-a580-6b551b5a0b5b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:26.576501 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:26.631578 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 135/274] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:26.632896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364859-56a2-482d-9d77-ea18c66dd0b1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:26.633185 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364859-56a2-482d-9d77-ea18c66dd0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:26.633464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364859-56a2-482d-9d77-ea18c66dd0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:26.671269 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f9364859-56a2-482d-9d77-ea18c66dd0b1 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:26.672567 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f9364859-56a2-482d-9d77-ea18c66dd0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:26.770304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78b7eb-4b3b-423d-a580-6b551b5a0b5b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:26.800056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 136/275] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:26.820302 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a87a4-bd58-41dd-adf8-628f28af76d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:26.820988 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a87a4-bd58-41dd-adf8-628f28af76d7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:26.821275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a87a4-bd58-41dd-adf8-628f28af76d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:26.821544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a87a4-bd58-41dd-adf8-628f28af76d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:26.833231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a87a4-bd58-41dd-adf8-628f28af76d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-526a87a4-bd58-41dd-adf8-628f28af76d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:26.838683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:26.839750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:26.840722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 140/276] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:26.848839 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9364859-56a2-482d-9d77-ea18c66dd0b1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:26.992380 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9364859-56a2-482d-9d77-ea18c66dd0b1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:26.999028 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a87a4-bd58-41dd-adf8-628f28af76d7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:27.006889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:27.010279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:27.045034 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a47e2-a413-4c49-b947-2553231cef21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:27.045644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a47e2-a413-4c49-b947-2553231cef21 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.045948 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a47e2-a413-4c49-b947-2553231cef21 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.046292 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a47e2-a413-4c49-b947-2553231cef21 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.047013 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a47e2-a413-4c49-b947-2553231cef21 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:27.047317 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a47e2-a413-4c49-b947-2553231cef21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:27.049202 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a47e2-a413-4c49-b947-2553231cef21 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:27.060897 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 137/277] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:27.062055 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b756b5-cffc-4311-ac8d-5e1f7568c3cd None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.062374 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b756b5-cffc-4311-ac8d-5e1f7568c3cd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.062647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b756b5-cffc-4311-ac8d-5e1f7568c3cd None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.063855 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 138/278] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:27.069346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b756b5-cffc-4311-ac8d-5e1f7568c3cd None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:27.116335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a87a4-bd58-41dd-adf8-628f28af76d7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:27.151135 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f1f56-4ec4-4fd5-b705-eec7f990a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:27.151759 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f1f56-4ec4-4fd5-b705-eec7f990a684 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.152037 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f1f56-4ec4-4fd5-b705-eec7f990a684 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.152309 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f1f56-4ec4-4fd5-b705-eec7f990a684 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.153416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f1f56-4ec4-4fd5-b705-eec7f990a684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:27.154903 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f1f56-4ec4-4fd5-b705-eec7f990a684 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:27.156463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 141/279] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:27.157547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00abac-2afd-4275-844f-617e45607273 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.157929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00abac-2afd-4275-844f-617e45607273 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.158238 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00abac-2afd-4275-844f-617e45607273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.176101 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3f00abac-2afd-4275-844f-617e45607273 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:27.177262 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3f00abac-2afd-4275-844f-617e45607273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:27.178948 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b756b5-cffc-4311-ac8d-5e1f7568c3cd None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:27.212076 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c581a-4f37-4a45-8f99-ef14e5f8e9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:27.212696 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c581a-4f37-4a45-8f99-ef14e5f8e9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.212972 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c581a-4f37-4a45-8f99-ef14e5f8e9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.213247 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c581a-4f37-4a45-8f99-ef14e5f8e9f8 None admin] PATH_INFO: `/v3/users/2acb00647d4a4bc4adc3e386633e3a49` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.227371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c581a-4f37-4a45-8f99-ef14e5f8e9f8 None admin] RBAC: Authorizing `identity:get_user(user_id=2acb00647d4a4bc4adc3e386633e3a49)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:27.228836 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c581a-4f37-4a45-8f99-ef14e5f8e9f8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:27.230466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 139/280] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:27 2022] GET /identity/v3/users/2acb00647d4a4bc4adc3e386633e3a49 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:27.235387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c581a-4f37-4a45-8f99-ef14e5f8e9f8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:27.244605 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 142/281] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:27.245477 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00abac-2afd-4275-844f-617e45607273 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:27.248531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:27.266635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:27.341566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c581a-4f37-4a45-8f99-ef14e5f8e9f8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:27.351929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00abac-2afd-4275-844f-617e45607273 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:27.379130 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470aee5-aadb-4b31-a603-0235fd39c2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:27.379933 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470aee5-aadb-4b31-a603-0235fd39c2ff None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.380212 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470aee5-aadb-4b31-a603-0235fd39c2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.380480 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470aee5-aadb-4b31-a603-0235fd39c2ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.390699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bf24d-51a6-4422-8198-774c886abd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:27.391049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470aee5-aadb-4b31-a603-0235fd39c2ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:27.391511 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bf24d-51a6-4422-8198-774c886abd12 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.391791 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bf24d-51a6-4422-8198-774c886abd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.392063 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521bf24d-51a6-4422-8198-774c886abd12 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.392701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bf24d-51a6-4422-8198-774c886abd12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:27.394246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521bf24d-51a6-4422-8198-774c886abd12 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7470aee5-aadb-4b31-a603-0235fd39c2ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:27.396587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:27.397421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 140/282] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:27.402905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470aee5-aadb-4b31-a603-0235fd39c2ff None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:27.486721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:27.498309 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470aee5-aadb-4b31-a603-0235fd39c2ff None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:27.502625 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 143/283] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:11:27 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:27.503589 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bf24d-51a6-4422-8198-774c886abd12 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:27.546963 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ec3df-2593-4570-b72d-f4a32068341f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:27.547574 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ec3df-2593-4570-b72d-f4a32068341f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.547854 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ec3df-2593-4570-b72d-f4a32068341f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.548129 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ec3df-2593-4570-b72d-f4a32068341f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.548871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ec3df-2593-4570-b72d-f4a32068341f None admin] RBAC: Adding query filter params (role.id=550a417973df4feda528c3e0787c1619, user.id=2acb00647d4a4bc4adc3e386633e3a49, scope.system=all) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:27.549178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ec3df-2593-4570-b72d-f4a32068341f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:27.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ec3df-2593-4570-b72d-f4a32068341f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:27.556653 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 141/284] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 23 07:11:27 2022] GET /identity/v3/role_assignments?user.id=2acb00647d4a4bc4adc3e386633e3a49&scope.system=all&role.id=550a417973df4feda528c3e0787c1619 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:27.556653 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ec3df-2593-4570-b72d-f4a32068341f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:27.622811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:27.688132 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521bf24d-51a6-4422-8198-774c886abd12 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:27.712795 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ec3df-2593-4570-b72d-f4a32068341f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:27.744230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef021c-4010-4f71-86cf-0b2386eef515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:27.745041 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef021c-4010-4f71-86cf-0b2386eef515 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.745320 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef021c-4010-4f71-86cf-0b2386eef515 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.745592 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef021c-4010-4f71-86cf-0b2386eef515 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.746369 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef021c-4010-4f71-86cf-0b2386eef515 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:27.746672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef021c-4010-4f71-86cf-0b2386eef515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:27.748109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ef021c-4010-4f71-86cf-0b2386eef515 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:27.759040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 144/285] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:27.762511 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a0b7f-97e5-4d30-8f68-4ceb05ff2b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:27.763383 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a0b7f-97e5-4d30-8f68-4ceb05ff2b25 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.763843 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a0b7f-97e5-4d30-8f68-4ceb05ff2b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.764115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a0b7f-97e5-4d30-8f68-4ceb05ff2b25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.765094 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef021c-4010-4f71-86cf-0b2386eef515 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:27.778234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a0b7f-97e5-4d30-8f68-4ceb05ff2b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-745a0b7f-97e5-4d30-8f68-4ceb05ff2b25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:27.784432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:27.785679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:27.786721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 142/286] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:27.792211 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a0b7f-97e5-4d30-8f68-4ceb05ff2b25 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:27.810458 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:27.911925 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef021c-4010-4f71-86cf-0b2386eef515 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:27.927602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a0b7f-97e5-4d30-8f68-4ceb05ff2b25 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:27.944604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:27.963102 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b02a5-8822-4ebd-b05f-44defde3d36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:27.963981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b02a5-8822-4ebd-b05f-44defde3d36c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.964651 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b02a5-8822-4ebd-b05f-44defde3d36c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.965478 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b02a5-8822-4ebd-b05f-44defde3d36c None admin] PATH_INFO: `/v3/users/d3dc2fc8bea54f17bd4c183742fe9ed7` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.967162 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b02a5-8822-4ebd-b05f-44defde3d36c None admin] RBAC: Authorizing `identity:get_user(user_id=d3dc2fc8bea54f17bd4c183742fe9ed7)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:27.970949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b02a5-8822-4ebd-b05f-44defde3d36c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:27.972056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 145/287] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:27 2022] GET /identity/v3/users/d3dc2fc8bea54f17bd4c183742fe9ed7 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:27.975746 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec28a2e-c2e9-42c3-81e1-5b9f5bd42f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:27.975746 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec28a2e-c2e9-42c3-81e1-5b9f5bd42f7b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:27.975746 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec28a2e-c2e9-42c3-81e1-5b9f5bd42f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:27.975746 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec28a2e-c2e9-42c3-81e1-5b9f5bd42f7b None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:27.976124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec28a2e-c2e9-42c3-81e1-5b9f5bd42f7b None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:27.976124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec28a2e-c2e9-42c3-81e1-5b9f5bd42f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:27.977321 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec28a2e-c2e9-42c3-81e1-5b9f5bd42f7b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:27.978328 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b02a5-8822-4ebd-b05f-44defde3d36c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:27.988195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 143/288] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:27.995037 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec28a2e-c2e9-42c3-81e1-5b9f5bd42f7b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:28.087506 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:28.118568 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec28a2e-c2e9-42c3-81e1-5b9f5bd42f7b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:28.162298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b02a5-8822-4ebd-b05f-44defde3d36c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:28.164726 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12b8d-2b38-4669-b476-a6ef722d7986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:28.165671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12b8d-2b38-4669-b476-a6ef722d7986 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:28.166147 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12b8d-2b38-4669-b476-a6ef722d7986 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:28.166619 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a12b8d-2b38-4669-b476-a6ef722d7986 None admin] PATH_INFO: `/v3/users/3dbdf66d4e624a7191d718e76e973bb6` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:28.167948 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a12b8d-2b38-4669-b476-a6ef722d7986 None admin] RBAC: Authorizing `identity:get_user(user_id=3dbdf66d4e624a7191d718e76e973bb6)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:28.169587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a12b8d-2b38-4669-b476-a6ef722d7986 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:28.178477 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 144/289] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:27 2022] GET /identity/v3/users/3dbdf66d4e624a7191d718e76e973bb6 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:28.179611 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12b8d-2b38-4669-b476-a6ef722d7986 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:28.202023 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107c896-d9d6-45f0-85cc-b50f3026fc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:28.202698 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107c896-d9d6-45f0-85cc-b50f3026fc4f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:28.202973 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107c896-d9d6-45f0-85cc-b50f3026fc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:28.203240 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107c896-d9d6-45f0-85cc-b50f3026fc4f None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:28.205682 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107c896-d9d6-45f0-85cc-b50f3026fc4f None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:28.207171 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107c896-d9d6-45f0-85cc-b50f3026fc4f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:28.209160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 146/290] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:27 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:28.215800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107c896-d9d6-45f0-85cc-b50f3026fc4f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:28.330495 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:28.391065 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a12b8d-2b38-4669-b476-a6ef722d7986 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:28.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107c896-d9d6-45f0-85cc-b50f3026fc4f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:28.462638 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5caf8f-4bcd-4abb-9a8d-9fd7075afa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:28.464272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5caf8f-4bcd-4abb-9a8d-9fd7075afa37 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:28.464755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5caf8f-4bcd-4abb-9a8d-9fd7075afa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:28.465761 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5caf8f-4bcd-4abb-9a8d-9fd7075afa37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:28.479472 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0871712-fce0-414e-8336-0be67a71ef32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:28.480466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0871712-fce0-414e-8336-0be67a71ef32 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:28.480965 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0871712-fce0-414e-8336-0be67a71ef32 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:28.481434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0871712-fce0-414e-8336-0be67a71ef32 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536/users/d3dc2fc8bea54f17bd4c183742fe9ed7/roles/32087f94c45f41e3bee5e95eda599d6f` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:28.483762 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0871712-fce0-414e-8336-0be67a71ef32 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc5ad8f68599461690aa33f7d63a0536, user_id=d3dc2fc8bea54f17bd4c183742fe9ed7, role_id=32087f94c45f41e3bee5e95eda599d6f)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:28.485588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0871712-fce0-414e-8336-0be67a71ef32 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:28.493965 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:28.554200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5caf8f-4bcd-4abb-9a8d-9fd7075afa37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:28.556039 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5caf8f-4bcd-4abb-9a8d-9fd7075afa37 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:28.587039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 147/291] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:11:28 2022] PUT /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536/users/d3dc2fc8bea54f17bd4c183742fe9ed7/roles/32087f94c45f41e3bee5e95eda599d6f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 07:11:28.765049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 145/292] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:28.771866 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0871712-fce0-414e-8336-0be67a71ef32 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:28.880216 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0871712-fce0-414e-8336-0be67a71ef32 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:28.906501 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:28.916629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb365ef-3a04-4dab-8bf2-31cfa031cda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:28.917321 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb365ef-3a04-4dab-8bf2-31cfa031cda3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:28.917542 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb365ef-3a04-4dab-8bf2-31cfa031cda3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:28.917812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb365ef-3a04-4dab-8bf2-31cfa031cda3 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:28.918992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb365ef-3a04-4dab-8bf2-31cfa031cda3 None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:28.920420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb365ef-3a04-4dab-8bf2-31cfa031cda3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:28.926422 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 148/293] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:28 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:28.928280 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5caf8f-4bcd-4abb-9a8d-9fd7075afa37 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:28.976975 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:29.039439 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5caf8f-4bcd-4abb-9a8d-9fd7075afa37 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:29.098807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459d48f-4da1-4f0a-8e5d-8d25228f04d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:29.099425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459d48f-4da1-4f0a-8e5d-8d25228f04d5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:29.099708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459d48f-4da1-4f0a-8e5d-8d25228f04d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:29.100041 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459d48f-4da1-4f0a-8e5d-8d25228f04d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:29.100785 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459d48f-4da1-4f0a-8e5d-8d25228f04d5 None admin] RBAC: Adding query filter params (role.id=550a417973df4feda528c3e0787c1619, scope.project.id=bc5ad8f68599461690aa33f7d63a0536, user.id=3dbdf66d4e624a7191d718e76e973bb6) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:29.101094 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459d48f-4da1-4f0a-8e5d-8d25228f04d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:29.102687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459d48f-4da1-4f0a-8e5d-8d25228f04d5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:29.119782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 146/294] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:28 2022] GET /identity/v3/role_assignments?user.id=3dbdf66d4e624a7191d718e76e973bb6&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=550a417973df4feda528c3e0787c1619 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:29.783567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2381fa4-5d53-4299-9cb9-9ce1dfd5e7e6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:29.784246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2381fa4-5d53-4299-9cb9-9ce1dfd5e7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:29.784762 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2381fa4-5d53-4299-9cb9-9ce1dfd5e7e6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:29.787383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 149/295] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:29.793082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b0049-9146-46e3-812b-fbdf90958a88 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:29.793524 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b0049-9146-46e3-812b-fbdf90958a88 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:29.793701 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b0049-9146-46e3-812b-fbdf90958a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:29.814392 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-cc6b0049-9146-46e3-812b-fbdf90958a88 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:29.815576 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-cc6b0049-9146-46e3-812b-fbdf90958a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:29.896894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 147/296] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:30.053028 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112c68-5fbe-434b-acf5-f375ce6b36a4 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:30.053548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112c68-5fbe-434b-acf5-f375ce6b36a4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:30.053548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05112c68-5fbe-434b-acf5-f375ce6b36a4 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:30.055308 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 150/297] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:30.060729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e137-bae7-4365-839c-a46e7d83ebe0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:30.061013 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e137-bae7-4365-839c-a46e7d83ebe0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:30.061286 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575e137-bae7-4365-839c-a46e7d83ebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:30.079519 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3575e137-bae7-4365-839c-a46e7d83ebe0 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:30.080698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3575e137-bae7-4365-839c-a46e7d83ebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:30.111459 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:30.151734 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 148/298] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:30.176750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112c68-5fbe-434b-acf5-f375ce6b36a4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:30.242037 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745406d-774a-47c1-8d1b-89b48cc1b0e9 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:30.242414 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745406d-774a-47c1-8d1b-89b48cc1b0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:30.242633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745406d-774a-47c1-8d1b-89b48cc1b0e9 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:30.244215 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 149/299] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:30.251657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ba5e3-edf4-47e6-9ea2-1bed35c74e3d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:30.252052 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ba5e3-edf4-47e6-9ea2-1bed35c74e3d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:30.252558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ba5e3-edf4-47e6-9ea2-1bed35c74e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:30.272521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-905ba5e3-edf4-47e6-9ea2-1bed35c74e3d None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:30.274025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-905ba5e3-edf4-47e6-9ea2-1bed35c74e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:30.296479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05112c68-5fbe-434b-acf5-f375ce6b36a4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:30.337778 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2311e2-65d1-4c34-a3cc-3ecdc10b80bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:30.338965 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2311e2-65d1-4c34-a3cc-3ecdc10b80bf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:30.339493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2311e2-65d1-4c34-a3cc-3ecdc10b80bf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:30.339962 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2311e2-65d1-4c34-a3cc-3ecdc10b80bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:30.354244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 150/300] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:30.359056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2311e2-65d1-4c34-a3cc-3ecdc10b80bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3e2311e2-65d1-4c34-a3cc-3ecdc10b80bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:30.364650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:30.365497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:30.366319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:30.368758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 151/301] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:30.374628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ba5e3-edf4-47e6-9ea2-1bed35c74e3d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:30.431799 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2311e2-65d1-4c34-a3cc-3ecdc10b80bf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:30.480930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:30.486956 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ba5e3-edf4-47e6-9ea2-1bed35c74e3d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:30.494767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:30.529174 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab65f3-ff87-42ba-a3c1-2751a9210301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:30.529782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab65f3-ff87-42ba-a3c1-2751a9210301 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:30.530062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab65f3-ff87-42ba-a3c1-2751a9210301 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:30.530365 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ab65f3-ff87-42ba-a3c1-2751a9210301 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:30.531039 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab65f3-ff87-42ba-a3c1-2751a9210301 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:30.531341 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab65f3-ff87-42ba-a3c1-2751a9210301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:30.533153 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ab65f3-ff87-42ba-a3c1-2751a9210301 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:30.544902 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 151/302] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:30.553554 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab65f3-ff87-42ba-a3c1-2751a9210301 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:30.565033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2311e2-65d1-4c34-a3cc-3ecdc10b80bf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:30.609402 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a3356-b721-4909-96cf-90f19b5d42b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:30.610037 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3356-b721-4909-96cf-90f19b5d42b6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:30.610358 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3356-b721-4909-96cf-90f19b5d42b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:30.610626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3356-b721-4909-96cf-90f19b5d42b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:30.623674 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a3356-b721-4909-96cf-90f19b5d42b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-558a3356-b721-4909-96cf-90f19b5d42b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:30.630366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:30.631265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:30.632036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 152/303] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:30.637710 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a3356-b721-4909-96cf-90f19b5d42b6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:30.687505 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ab65f3-ff87-42ba-a3c1-2751a9210301 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:30.724684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae187e-3191-4b78-9996-4e52c71dcfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:30.725303 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae187e-3191-4b78-9996-4e52c71dcfb6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:30.725586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae187e-3191-4b78-9996-4e52c71dcfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:30.725850 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae187e-3191-4b78-9996-4e52c71dcfb6 None admin] PATH_INFO: `/v3/users/2acb00647d4a4bc4adc3e386633e3a49` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:30.727004 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae187e-3191-4b78-9996-4e52c71dcfb6 None admin] RBAC: Authorizing `identity:get_user(user_id=2acb00647d4a4bc4adc3e386633e3a49)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:30.728440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae187e-3191-4b78-9996-4e52c71dcfb6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:30.734679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 152/304] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:30 2022] GET /identity/v3/users/2acb00647d4a4bc4adc3e386633e3a49 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:30.734679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae187e-3191-4b78-9996-4e52c71dcfb6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:30.763226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:30.763547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a3356-b721-4909-96cf-90f19b5d42b6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:30.772920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:30.804456 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec8b7b-7481-4a83-987b-c8e0c99f80f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:30.805712 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec8b7b-7481-4a83-987b-c8e0c99f80f0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:30.806262 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec8b7b-7481-4a83-987b-c8e0c99f80f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:30.806894 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec8b7b-7481-4a83-987b-c8e0c99f80f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:30.808532 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec8b7b-7481-4a83-987b-c8e0c99f80f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:30.809040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec8b7b-7481-4a83-987b-c8e0c99f80f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:30.810685 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec8b7b-7481-4a83-987b-c8e0c99f80f0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:30.822620 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 153/305] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:30.824048 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec8b7b-7481-4a83-987b-c8e0c99f80f0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:30.839887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae187e-3191-4b78-9996-4e52c71dcfb6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:30.877108 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418c6af-772f-4eb0-99e3-314fe496d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:30.877729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c6af-772f-4eb0-99e3-314fe496d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:30.878013 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c6af-772f-4eb0-99e3-314fe496d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:30.878314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418c6af-772f-4eb0-99e3-314fe496d3b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:30.880008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418c6af-772f-4eb0-99e3-314fe496d3b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:30.881439 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418c6af-772f-4eb0-99e3-314fe496d3b2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:30.886260 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 153/306] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:30.887122 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418c6af-772f-4eb0-99e3-314fe496d3b2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:30.928101 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec8b7b-7481-4a83-987b-c8e0c99f80f0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:30.961235 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7045f3-0c2f-43df-b0e9-b15db770c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:30.961813 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7045f3-0c2f-43df-b0e9-b15db770c4da None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:30.962091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7045f3-0c2f-43df-b0e9-b15db770c4da None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:30.962395 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7045f3-0c2f-43df-b0e9-b15db770c4da None admin] PATH_INFO: `/v3/system/users/2acb00647d4a4bc4adc3e386633e3a49/roles/550a417973df4feda528c3e0787c1619` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:30.963797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7045f3-0c2f-43df-b0e9-b15db770c4da None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2acb00647d4a4bc4adc3e386633e3a49, role_id=550a417973df4feda528c3e0787c1619)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:30.965172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7045f3-0c2f-43df-b0e9-b15db770c4da None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:30.978280 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:30.984742 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418c6af-772f-4eb0-99e3-314fe496d3b2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:31.018059 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0795f44-adea-4bcc-83c3-3279c2ec6eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:31.018695 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795f44-adea-4bcc-83c3-3279c2ec6eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:31.018974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795f44-adea-4bcc-83c3-3279c2ec6eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:31.019244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0795f44-adea-4bcc-83c3-3279c2ec6eb8 None admin] PATH_INFO: `/v3/users/683d81580bda472a885a4e95d670b3df` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:31.028644 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 154/307] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Aug 23 07:11:30 2022] PUT /identity/v3/system/users/2acb00647d4a4bc4adc3e386633e3a49/roles/550a417973df4feda528c3e0787c1619 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:31.029911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ec76-98f1-4071-b8ec-dc3cc4f5afaa None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:31.030356 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ec76-98f1-4071-b8ec-dc3cc4f5afaa None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:31.030582 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0ec76-98f1-4071-b8ec-dc3cc4f5afaa None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:31.031942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 155/308] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:31.036185 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0ec76-98f1-4071-b8ec-dc3cc4f5afaa None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:31.037207 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0795f44-adea-4bcc-83c3-3279c2ec6eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=683d81580bda472a885a4e95d670b3df)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:31.038769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0795f44-adea-4bcc-83c3-3279c2ec6eb8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:31.040532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 154/309] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:30 2022] GET /identity/v3/users/683d81580bda472a885a4e95d670b3df => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:31.041861 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ce84b-01aa-4266-bc11-114aa77ed5e1 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:31.042173 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ce84b-01aa-4266-bc11-114aa77ed5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:31.042449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ce84b-01aa-4266-bc11-114aa77ed5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:31.063693 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-232ce84b-01aa-4266-bc11-114aa77ed5e1 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:31.064902 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-232ce84b-01aa-4266-bc11-114aa77ed5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:31.073600 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:31.142125 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 155/310] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:31.143284 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ce84b-01aa-4266-bc11-114aa77ed5e1 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:31.172774 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0ec76-98f1-4071-b8ec-dc3cc4f5afaa None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:31.215863 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652e53a-a2cb-44a3-afd4-09444f5f68d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:31.216413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652e53a-a2cb-44a3-afd4-09444f5f68d0 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:31.216686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652e53a-a2cb-44a3-afd4-09444f5f68d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:31.216952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652e53a-a2cb-44a3-afd4-09444f5f68d0 None admin] PATH_INFO: `/v3/groups` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:31.217574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652e53a-a2cb-44a3-afd4-09444f5f68d0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:31.219285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652e53a-a2cb-44a3-afd4-09444f5f68d0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:31.252450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:31.270764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ce84b-01aa-4266-bc11-114aa77ed5e1 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:31.293156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 156/311] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Aug 23 07:11:31 2022] POST /identity/v3/groups => generated 229 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:31.317555 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6a09-721e-4ddf-a643-834f981f15df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:31.318520 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6a09-721e-4ddf-a643-834f981f15df None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:31.318954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6a09-721e-4ddf-a643-834f981f15df None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:31.319234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c6a09-721e-4ddf-a643-834f981f15df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:31.320169 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c6a09-721e-4ddf-a643-834f981f15df None admin] RBAC: Adding query filter params (role.id=32087f94c45f41e3bee5e95eda599d6f, user.id=683d81580bda472a885a4e95d670b3df, scope.system=all) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:31.320490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c6a09-721e-4ddf-a643-834f981f15df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:31.322077 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c6a09-721e-4ddf-a643-834f981f15df None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:31.328405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 156/312] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 23 07:11:31 2022] GET /identity/v3/role_assignments?user.id=683d81580bda472a885a4e95d670b3df&scope.system=all&role.id=32087f94c45f41e3bee5e95eda599d6f => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:31.423442 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652e53a-a2cb-44a3-afd4-09444f5f68d0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:31.529356 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:31.539053 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652e53a-a2cb-44a3-afd4-09444f5f68d0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:31.575239 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e5106-b3a1-48a1-9462-655a62f44a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:31.575880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5106-b3a1-48a1-9462-655a62f44a28 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:31.576157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5106-b3a1-48a1-9462-655a62f44a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:31.576425 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e5106-b3a1-48a1-9462-655a62f44a28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:31.589074 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e5106-b3a1-48a1-9462-655a62f44a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-999e5106-b3a1-48a1-9462-655a62f44a28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:31.594715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:31.595627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:31.596383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 157/313] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:31.602859 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6a09-721e-4ddf-a643-834f981f15df None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:31.706599 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c6a09-721e-4ddf-a643-834f981f15df None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:31.743759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c67daa-06b9-4a14-a021-222b3f74c09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:31.744358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c67daa-06b9-4a14-a021-222b3f74c09a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:31.744683 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c67daa-06b9-4a14-a021-222b3f74c09a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:31.744956 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c67daa-06b9-4a14-a021-222b3f74c09a None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:31.745617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c67daa-06b9-4a14-a021-222b3f74c09a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:31.745915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c67daa-06b9-4a14-a021-222b3f74c09a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:31.747385 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c67daa-06b9-4a14-a021-222b3f74c09a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:31.756389 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 157/314] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:31.761891 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e5106-b3a1-48a1-9462-655a62f44a28 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:31.871887 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e5106-b3a1-48a1-9462-655a62f44a28 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:31.907341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f365b-52ca-49d7-954b-a1619da34723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:31.908406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f365b-52ca-49d7-954b-a1619da34723 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:31.908897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f365b-52ca-49d7-954b-a1619da34723 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:31.909378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f365b-52ca-49d7-954b-a1619da34723 None admin] PATH_INFO: `/v3/users/d3dc2fc8bea54f17bd4c183742fe9ed7` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:31.911285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f365b-52ca-49d7-954b-a1619da34723 None admin] RBAC: Authorizing `identity:get_user(user_id=d3dc2fc8bea54f17bd4c183742fe9ed7)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:31.912918 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039f365b-52ca-49d7-954b-a1619da34723 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:31.914698 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 158/315] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:31 2022] GET /identity/v3/users/d3dc2fc8bea54f17bd4c183742fe9ed7 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:31.922154 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c67daa-06b9-4a14-a021-222b3f74c09a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:31.938430 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:32.026596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c67daa-06b9-4a14-a021-222b3f74c09a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:32.061485 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81986e-5fc8-4a8f-8ef8-e212517b0361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:32.062152 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81986e-5fc8-4a8f-8ef8-e212517b0361 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:32.062438 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81986e-5fc8-4a8f-8ef8-e212517b0361 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:32.062706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81986e-5fc8-4a8f-8ef8-e212517b0361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:32.132233 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81986e-5fc8-4a8f-8ef8-e212517b0361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:32.133597 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81986e-5fc8-4a8f-8ef8-e212517b0361 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:32.171987 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:32.236621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 158/316] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:32.242330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f365b-52ca-49d7-954b-a1619da34723 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:32.265381 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:32.346284 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f365b-52ca-49d7-954b-a1619da34723 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:32.382191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50dfd1a-b683-41dc-a8e1-174791314d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:32.383237 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dfd1a-b683-41dc-a8e1-174791314d5d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:32.383720 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dfd1a-b683-41dc-a8e1-174791314d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:32.384180 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50dfd1a-b683-41dc-a8e1-174791314d5d None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:32.385506 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dfd1a-b683-41dc-a8e1-174791314d5d None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:32.387166 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50dfd1a-b683-41dc-a8e1-174791314d5d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:32.389324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 159/317] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:32 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:32.395657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81986e-5fc8-4a8f-8ef8-e212517b0361 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:32.503369 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81986e-5fc8-4a8f-8ef8-e212517b0361 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:32.512767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:32.539139 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144fd8-e351-404c-80ef-a7caf0aa83b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:32.539738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144fd8-e351-404c-80ef-a7caf0aa83b0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:32.540016 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144fd8-e351-404c-80ef-a7caf0aa83b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:32.540293 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144fd8-e351-404c-80ef-a7caf0aa83b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:32.541014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144fd8-e351-404c-80ef-a7caf0aa83b0 None admin] RBAC: Adding query filter params (role.id=32087f94c45f41e3bee5e95eda599d6f, scope.project.id=bc5ad8f68599461690aa33f7d63a0536, user.id=d3dc2fc8bea54f17bd4c183742fe9ed7) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:32.541342 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144fd8-e351-404c-80ef-a7caf0aa83b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:32.542792 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144fd8-e351-404c-80ef-a7caf0aa83b0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:32.549044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 159/318] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:11:32 2022] GET /identity/v3/role_assignments?user.id=d3dc2fc8bea54f17bd4c183742fe9ed7&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=32087f94c45f41e3bee5e95eda599d6f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:33.075103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc55e0-7535-4f3d-a980-2c674fc4d215 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:33.075506 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc55e0-7535-4f3d-a980-2c674fc4d215 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:33.075751 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc55e0-7535-4f3d-a980-2c674fc4d215 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:33.077222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 160/319] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:33.082970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146f7a-f2b6-4bac-8919-a5f8e0bd2edf None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:33.083428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146f7a-f2b6-4bac-8919-a5f8e0bd2edf None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:33.083594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15146f7a-f2b6-4bac-8919-a5f8e0bd2edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:33.102466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-15146f7a-f2b6-4bac-8919-a5f8e0bd2edf None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:33.103640 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-15146f7a-f2b6-4bac-8919-a5f8e0bd2edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:33.172988 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 160/320] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:33.277931 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa7109-f0ef-47b9-854e-a9423da39eec None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:33.278484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa7109-f0ef-47b9-854e-a9423da39eec None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:33.278484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa7109-f0ef-47b9-854e-a9423da39eec None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:33.279961 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 161/321] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:33.285403 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f071-ad18-4ded-8764-5dba03cd4c7e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:33.285699 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f071-ad18-4ded-8764-5dba03cd4c7e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:33.285969 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7f071-ad18-4ded-8764-5dba03cd4c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:33.304198 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-63c7f071-ad18-4ded-8764-5dba03cd4c7e None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:33.305364 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-63c7f071-ad18-4ded-8764-5dba03cd4c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:33.314642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a015773-d9bc-410d-a60b-a5fd436d3928 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:33.314927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a015773-d9bc-410d-a60b-a5fd436d3928 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:33.315224 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a015773-d9bc-410d-a60b-a5fd436d3928 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:33.317261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 162/322] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:33.322422 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a2559-e666-4d8e-925e-700361d5419a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:33.322711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a2559-e666-4d8e-925e-700361d5419a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:33.322987 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a2559-e666-4d8e-925e-700361d5419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:33.340420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f53a2559-e666-4d8e-925e-700361d5419a None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:33.341542 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f53a2559-e666-4d8e-925e-700361d5419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:33.382149 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 161/323] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:33.413031 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 163/324] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:33.443487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7f071-ad18-4ded-8764-5dba03cd4c7e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:33.475855 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:33.544760 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7f071-ad18-4ded-8764-5dba03cd4c7e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:33.578828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4288f9-0835-49c7-990e-93df948d75a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:33.579451 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4288f9-0835-49c7-990e-93df948d75a8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:33.579793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4288f9-0835-49c7-990e-93df948d75a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:33.580064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4288f9-0835-49c7-990e-93df948d75a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:33.600883 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4288f9-0835-49c7-990e-93df948d75a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-9a4288f9-0835-49c7-990e-93df948d75a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:33.605536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:33.606449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:33.607224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:33.610438 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 162/325] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:33.612419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a2559-e666-4d8e-925e-700361d5419a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:33.632358 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:33.658791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4288f9-0835-49c7-990e-93df948d75a8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:33.716153 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a2559-e666-4d8e-925e-700361d5419a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:33.750055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe93a43-6736-41f9-9965-7232950c1c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:33.750759 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93a43-6736-41f9-9965-7232950c1c0d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:33.751069 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93a43-6736-41f9-9965-7232950c1c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:33.751341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe93a43-6736-41f9-9965-7232950c1c0d None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:33.752005 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe93a43-6736-41f9-9965-7232950c1c0d None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:33.752311 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe93a43-6736-41f9-9965-7232950c1c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:33.752725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:33.753973 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe93a43-6736-41f9-9965-7232950c1c0d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:33.760934 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4288f9-0835-49c7-990e-93df948d75a8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:33.762226 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 164/326] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:33.762831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe93a43-6736-41f9-9965-7232950c1c0d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:33.799505 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0aede1-be1e-4cdf-b921-7763c371f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:33.800158 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aede1-be1e-4cdf-b921-7763c371f0fa None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:33.801027 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aede1-be1e-4cdf-b921-7763c371f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:33.801370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aede1-be1e-4cdf-b921-7763c371f0fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:33.802512 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0aede1-be1e-4cdf-b921-7763c371f0fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:33.803949 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0aede1-be1e-4cdf-b921-7763c371f0fa None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:33.805795 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 163/327] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:33.806597 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0aede1-be1e-4cdf-b921-7763c371f0fa None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:33.850299 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:33.869219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe93a43-6736-41f9-9965-7232950c1c0d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:33.903932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31604908-a52f-474b-9a48-34195a5d8389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:33.904547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31604908-a52f-474b-9a48-34195a5d8389 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:33.904822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31604908-a52f-474b-9a48-34195a5d8389 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:33.905075 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0aede1-be1e-4cdf-b921-7763c371f0fa None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:33.905167 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31604908-a52f-474b-9a48-34195a5d8389 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:33.915964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31604908-a52f-474b-9a48-34195a5d8389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-31604908-a52f-474b-9a48-34195a5d8389 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:33.920622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:33.921448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:33.922266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 165/328] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:33.922958 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31604908-a52f-474b-9a48-34195a5d8389 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:33.939705 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d207486-8265-413a-8ad2-063000708474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:33.940351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d207486-8265-413a-8ad2-063000708474 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:33.940623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d207486-8265-413a-8ad2-063000708474 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:33.940894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d207486-8265-413a-8ad2-063000708474 None admin] PATH_INFO: `/v3/users/2acb00647d4a4bc4adc3e386633e3a49` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:33.942196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d207486-8265-413a-8ad2-063000708474 None admin] RBAC: Authorizing `identity:get_user(user_id=2acb00647d4a4bc4adc3e386633e3a49)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:33.943636 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d207486-8265-413a-8ad2-063000708474 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:33.945200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 164/329] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:33 2022] GET /identity/v3/users/2acb00647d4a4bc4adc3e386633e3a49 => generated 293 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:33.946012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d207486-8265-413a-8ad2-063000708474 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:33.974828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:34.044634 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d207486-8265-413a-8ad2-063000708474 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:34.059658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31604908-a52f-474b-9a48-34195a5d8389 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:34.077294 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3d351-f4b4-458a-89b6-63bb880e4b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:34.077958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3d351-f4b4-458a-89b6-63bb880e4b46 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:34.078325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3d351-f4b4-458a-89b6-63bb880e4b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:34.078598 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3d351-f4b4-458a-89b6-63bb880e4b46 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:34.079249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3d351-f4b4-458a-89b6-63bb880e4b46 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:34.079543 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3d351-f4b4-458a-89b6-63bb880e4b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:34.080927 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3d351-f4b4-458a-89b6-63bb880e4b46 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:34.089449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 165/330] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:34.090027 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3d351-f4b4-458a-89b6-63bb880e4b46 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:34.097218 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948caba-27cd-467f-b7ba-21850bb509f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:34.098792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948caba-27cd-467f-b7ba-21850bb509f4 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:34.099115 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948caba-27cd-467f-b7ba-21850bb509f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:34.099386 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948caba-27cd-467f-b7ba-21850bb509f4 None admin] PATH_INFO: `/v3/groups` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:34.100001 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948caba-27cd-467f-b7ba-21850bb509f4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:34.101431 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948caba-27cd-467f-b7ba-21850bb509f4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:34.154803 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:34.159190 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 166/331] 10.222.0.16 () {60 vars in 1134 bytes} [Tue Aug 23 07:11:33 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:34.160595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948caba-27cd-467f-b7ba-21850bb509f4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:34.183132 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:34.195579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3d351-f4b4-458a-89b6-63bb880e4b46 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:34.234670 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99664bd9-8a9b-454a-8f5c-e1d1f60e90c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:34.235358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99664bd9-8a9b-454a-8f5c-e1d1f60e90c7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:34.235611 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99664bd9-8a9b-454a-8f5c-e1d1f60e90c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:34.235880 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99664bd9-8a9b-454a-8f5c-e1d1f60e90c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:34.236619 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99664bd9-8a9b-454a-8f5c-e1d1f60e90c7 None admin] RBAC: Adding query filter params (role.id=550a417973df4feda528c3e0787c1619, user.id=2acb00647d4a4bc4adc3e386633e3a49, scope.system=all) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:34.236928 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99664bd9-8a9b-454a-8f5c-e1d1f60e90c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:34.238815 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99664bd9-8a9b-454a-8f5c-e1d1f60e90c7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:34.251511 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 166/332] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 23 07:11:34 2022] GET /identity/v3/role_assignments?user.id=2acb00647d4a4bc4adc3e386633e3a49&scope.system=all&role.id=550a417973df4feda528c3e0787c1619 => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:34.275883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948caba-27cd-467f-b7ba-21850bb509f4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:34.315464 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9298f-fe39-4cba-bf99-cd904eceabda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:34.316744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9298f-fe39-4cba-bf99-cd904eceabda None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:34.317081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9298f-fe39-4cba-bf99-cd904eceabda None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:34.317326 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9298f-fe39-4cba-bf99-cd904eceabda None admin] PATH_INFO: `/v3/users/683d81580bda472a885a4e95d670b3df` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:34.318546 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9298f-fe39-4cba-bf99-cd904eceabda None admin] RBAC: Authorizing `identity:get_user(user_id=683d81580bda472a885a4e95d670b3df)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:34.320029 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9298f-fe39-4cba-bf99-cd904eceabda None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:34.321705 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 167/333] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:34 2022] GET /identity/v3/users/683d81580bda472a885a4e95d670b3df => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:34.327930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99664bd9-8a9b-454a-8f5c-e1d1f60e90c7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:34.448302 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99664bd9-8a9b-454a-8f5c-e1d1f60e90c7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:34.485202 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d843cf1-15b8-4f80-9ed2-1d666ab370aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:34.485849 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843cf1-15b8-4f80-9ed2-1d666ab370aa None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:34.486146 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843cf1-15b8-4f80-9ed2-1d666ab370aa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:34.486425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843cf1-15b8-4f80-9ed2-1d666ab370aa None admin] PATH_INFO: `/v3/system/users/683d81580bda472a885a4e95d670b3df/roles/32087f94c45f41e3bee5e95eda599d6f` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:34.487922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d843cf1-15b8-4f80-9ed2-1d666ab370aa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=683d81580bda472a885a4e95d670b3df, role_id=32087f94c45f41e3bee5e95eda599d6f)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:34.489665 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d843cf1-15b8-4f80-9ed2-1d666ab370aa None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:34.543221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 167/334] 10.222.0.16 () {58 vars in 1334 bytes} [Tue Aug 23 07:11:34 2022] PUT /identity/v3/system/users/683d81580bda472a885a4e95d670b3df/roles/32087f94c45f41e3bee5e95eda599d6f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:36.504634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aefd8-e811-41d7-a98a-ea2ad49a1e87 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:36.505137 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aefd8-e811-41d7-a98a-ea2ad49a1e87 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:36.505212 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6aefd8-e811-41d7-a98a-ea2ad49a1e87 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:36.506813 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 168/335] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:36.512311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bb428-d2cb-4673-a77c-1d96b21cfe64 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:36.512713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bb428-d2cb-4673-a77c-1d96b21cfe64 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:36.512903 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bb428-d2cb-4673-a77c-1d96b21cfe64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:36.535320 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4b9bb428-d2cb-4673-a77c-1d96b21cfe64 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:36.536680 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4b9bb428-d2cb-4673-a77c-1d96b21cfe64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:36.548504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:36.624870 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6224894-7bb1-4c4e-bad0-b8bfa8457893 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:36.625178 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6224894-7bb1-4c4e-bad0-b8bfa8457893 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:36.625423 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6224894-7bb1-4c4e-bad0-b8bfa8457893 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:36.628177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 169/336] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:36.633389 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc100-16bc-470e-b3fd-363b099b2009 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:36.633675 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc100-16bc-470e-b3fd-363b099b2009 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:36.633954 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc100-16bc-470e-b3fd-363b099b2009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:36.634354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 168/337] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:36.663201 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-403dc100-16bc-470e-b3fd-363b099b2009 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:36.664482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-403dc100-16bc-470e-b3fd-363b099b2009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:36.736771 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:36.746256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 170/338] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:36.988275 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bb428-d2cb-4673-a77c-1d96b21cfe64 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:36.989687 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21f16-fbfa-4de0-a611-db3a477f3a24 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:36.989975 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21f16-fbfa-4de0-a611-db3a477f3a24 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:36.990271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21f16-fbfa-4de0-a611-db3a477f3a24 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:36.991900 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 171/339] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:36.998000 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872e8bf-2b61-4fb9-8538-5e869e8be7df None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:36.998301 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872e8bf-2b61-4fb9-8538-5e869e8be7df None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:36.998574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872e8bf-2b61-4fb9-8538-5e869e8be7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:37.027130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c872e8bf-2b61-4fb9-8538-5e869e8be7df None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:37.028325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c872e8bf-2b61-4fb9-8538-5e869e8be7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:37.109131 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bb428-d2cb-4673-a77c-1d96b21cfe64 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:37.141554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 172/340] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:37.142943 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a686394-5324-40af-a989-2285df57fdf7 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:37.143226 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a686394-5324-40af-a989-2285df57fdf7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:37.143492 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a686394-5324-40af-a989-2285df57fdf7 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:37.145626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 173/341] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:37.146484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a686394-5324-40af-a989-2285df57fdf7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:37.151729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcfc9d-2577-4eef-af24-447519d0ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:37.152372 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcfc9d-2577-4eef-af24-447519d0ec7f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:37.152647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcfc9d-2577-4eef-af24-447519d0ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:37.152913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcfc9d-2577-4eef-af24-447519d0ec7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:37.164260 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcfc9d-2577-4eef-af24-447519d0ec7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-51bcfc9d-2577-4eef-af24-447519d0ec7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:37.169040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:37.169894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:37.170766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 169/342] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:37.171423 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb999-e10b-4703-a971-4931dd870d87 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:37.171958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb999-e10b-4703-a971-4931dd870d87 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:37.171958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35feb999-e10b-4703-a971-4931dd870d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:37.181895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:37.194907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-35feb999-e10b-4703-a971-4931dd870d87 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:37.196207 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-35feb999-e10b-4703-a971-4931dd870d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:37.269906 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 170/343] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:37.270724 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feb999-e10b-4703-a971-4931dd870d87 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:37.310791 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a686394-5324-40af-a989-2285df57fdf7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:37.347938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:37.370840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf345abe-38be-4fcf-83d7-19c00b7e6b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:37.371487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf345abe-38be-4fcf-83d7-19c00b7e6b95 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:37.371762 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf345abe-38be-4fcf-83d7-19c00b7e6b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:37.372030 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf345abe-38be-4fcf-83d7-19c00b7e6b95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:37.391396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf345abe-38be-4fcf-83d7-19c00b7e6b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-cf345abe-38be-4fcf-83d7-19c00b7e6b95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:37.396565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:37.397494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:37.398680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 174/344] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:37.407060 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf345abe-38be-4fcf-83d7-19c00b7e6b95 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:37.432202 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35feb999-e10b-4703-a971-4931dd870d87 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:37.473170 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:37.486789 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d2a2f-6709-42b5-938a-b37da9285de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:37.487406 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d2a2f-6709-42b5-938a-b37da9285de3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:37.487744 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d2a2f-6709-42b5-938a-b37da9285de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:37.488498 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d2a2f-6709-42b5-938a-b37da9285de3 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:37.489190 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d2a2f-6709-42b5-938a-b37da9285de3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:37.489503 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d2a2f-6709-42b5-938a-b37da9285de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:37.490919 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d2a2f-6709-42b5-938a-b37da9285de3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:37.505974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 171/345] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:37.511438 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d2a2f-6709-42b5-938a-b37da9285de3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:37.552942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf345abe-38be-4fcf-83d7-19c00b7e6b95 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:37.609057 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ed7ce-b8c0-442d-a50f-b6cc256d0bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:37.609671 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed7ce-b8c0-442d-a50f-b6cc256d0bbc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:37.609948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed7ce-b8c0-442d-a50f-b6cc256d0bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:37.610244 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ed7ce-b8c0-442d-a50f-b6cc256d0bbc None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:37.610909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ed7ce-b8c0-442d-a50f-b6cc256d0bbc None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:37.611203 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ed7ce-b8c0-442d-a50f-b6cc256d0bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:37.612588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ed7ce-b8c0-442d-a50f-b6cc256d0bbc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:37.625555 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 175/346] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:37.635071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ed7ce-b8c0-442d-a50f-b6cc256d0bbc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:37.668278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d2a2f-6709-42b5-938a-b37da9285de3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:37.713647 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:37.759427 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2fbf6-6841-4fdc-aa31-abba6b3c2c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:37.760052 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2fbf6-6841-4fdc-aa31-abba6b3c2c92 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:37.760343 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2fbf6-6841-4fdc-aa31-abba6b3c2c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:37.760592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2fbf6-6841-4fdc-aa31-abba6b3c2c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:37.783215 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ed7ce-b8c0-442d-a50f-b6cc256d0bbc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:37.825998 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20959d47-b3be-4b29-a375-7117f888f419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:37.826554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20959d47-b3be-4b29-a375-7117f888f419 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:37.826831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20959d47-b3be-4b29-a375-7117f888f419 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:37.827097 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20959d47-b3be-4b29-a375-7117f888f419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:37.908443 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:37.914229 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20959d47-b3be-4b29-a375-7117f888f419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:37.915765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20959d47-b3be-4b29-a375-7117f888f419 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:37.928377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2fbf6-6841-4fdc-aa31-abba6b3c2c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:37.929840 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2fbf6-6841-4fdc-aa31-abba6b3c2c92 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:37.981409 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:38.044011 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 176/347] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:38.045094 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20959d47-b3be-4b29-a375-7117f888f419 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:38.055526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 172/348] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 07:11:38.056705 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2fbf6-6841-4fdc-aa31-abba6b3c2c92 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:38.158114 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:38.161849 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20959d47-b3be-4b29-a375-7117f888f419 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:38.167924 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2fbf6-6841-4fdc-aa31-abba6b3c2c92 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:38.204593 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1c53-441b-4898-a291-cbf57a459d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:38.205581 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1c53-441b-4898-a291-cbf57a459d90 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:38.206042 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1c53-441b-4898-a291-cbf57a459d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:38.206369 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce1c53-441b-4898-a291-cbf57a459d90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:38.207251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44666125-e4d3-4186-a381-ae6d3a6ffaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:38.207952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666125-e4d3-4186-a381-ae6d3a6ffaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:38.208236 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666125-e4d3-4186-a381-ae6d3a6ffaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:38.208510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666125-e4d3-4186-a381-ae6d3a6ffaf1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:38.224038 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce1c53-441b-4898-a291-cbf57a459d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:38.225735 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44666125-e4d3-4186-a381-ae6d3a6ffaf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-81ce1c53-441b-4898-a291-cbf57a459d90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:38.228830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:38.229691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:38.230510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-44666125-e4d3-4186-a381-ae6d3a6ffaf1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:38.233872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:38.234953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 07:11:38.235753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:38.237322 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 173/349] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:38.237322 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1c53-441b-4898-a291-cbf57a459d90 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:38.240390 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 177/350] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:38.242497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44666125-e4d3-4186-a381-ae6d3a6ffaf1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:38.256259 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:38.359468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce1c53-441b-4898-a291-cbf57a459d90 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:38.370977 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44666125-e4d3-4186-a381-ae6d3a6ffaf1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:38.406939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769df85-793e-428b-b326-ac1a167dbc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:38.407904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769df85-793e-428b-b326-ac1a167dbc1e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:38.408507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769df85-793e-428b-b326-ac1a167dbc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:38.408741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769df85-793e-428b-b326-ac1a167dbc1e None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:38.411465 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769df85-793e-428b-b326-ac1a167dbc1e None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:38.413942 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769df85-793e-428b-b326-ac1a167dbc1e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:38.415880 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 174/351] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:38 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:38.416463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769df85-793e-428b-b326-ac1a167dbc1e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:38.424077 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd879323-7031-422f-9127-3ac9dd9db4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:38.424729 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd879323-7031-422f-9127-3ac9dd9db4ab None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:38.425006 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd879323-7031-422f-9127-3ac9dd9db4ab None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:38.425886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd879323-7031-422f-9127-3ac9dd9db4ab None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:38.427089 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd879323-7031-422f-9127-3ac9dd9db4ab None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:38.428951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd879323-7031-422f-9127-3ac9dd9db4ab None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:38.432941 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 178/352] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:38 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:38.432941 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d340-e02f-4247-8b06-18312d9260fd None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:38.432941 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d340-e02f-4247-8b06-18312d9260fd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:38.433202 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d340-e02f-4247-8b06-18312d9260fd None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:38.434374 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 179/353] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:38.435051 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78d340-e02f-4247-8b06-18312d9260fd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:38.447598 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:38.530300 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:38.547017 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769df85-793e-428b-b326-ac1a167dbc1e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:38.569157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78d340-e02f-4247-8b06-18312d9260fd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:38.598397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7808d-658c-4bc1-a6d2-969ecd808cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:38.599018 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7808d-658c-4bc1-a6d2-969ecd808cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:38.599295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7808d-658c-4bc1-a6d2-969ecd808cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:38.599584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7808d-658c-4bc1-a6d2-969ecd808cc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:38.600254 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7808d-658c-4bc1-a6d2-969ecd808cc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:38.600552 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7808d-658c-4bc1-a6d2-969ecd808cc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:38.601922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7808d-658c-4bc1-a6d2-969ecd808cc4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:38.613943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 175/354] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:38.614877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7808d-658c-4bc1-a6d2-969ecd808cc4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:38.625206 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f9937-9431-4d69-bed2-777c49ee8f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:38.625912 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f9937-9431-4d69-bed2-777c49ee8f01 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:38.626313 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f9937-9431-4d69-bed2-777c49ee8f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:38.626654 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f9937-9431-4d69-bed2-777c49ee8f01 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:38.627415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f9937-9431-4d69-bed2-777c49ee8f01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:38.629191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f9937-9431-4d69-bed2-777c49ee8f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:38.631090 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42f9937-9431-4d69-bed2-777c49ee8f01 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:38.641426 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 180/355] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:38.642389 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f9937-9431-4d69-bed2-777c49ee8f01 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:38.730750 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:38.750739 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7808d-658c-4bc1-a6d2-969ecd808cc4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:38.766714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f9937-9431-4d69-bed2-777c49ee8f01 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:38.798965 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25d8ad-a3bd-4f63-9a7c-20c66aa43f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:38.799596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25d8ad-a3bd-4f63-9a7c-20c66aa43f1c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:38.799883 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25d8ad-a3bd-4f63-9a7c-20c66aa43f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:38.800202 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25d8ad-a3bd-4f63-9a7c-20c66aa43f1c None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:38.808396 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25d8ad-a3bd-4f63-9a7c-20c66aa43f1c None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:38.810244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b25d8ad-a3bd-4f63-9a7c-20c66aa43f1c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:38.811643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 176/356] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:38 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:38.811750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812e690-1bf7-4fcc-88f2-d3cb826eb35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:38.812313 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812e690-1bf7-4fcc-88f2-d3cb826eb35d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:38.813878 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812e690-1bf7-4fcc-88f2-d3cb826eb35d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:38.813878 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812e690-1bf7-4fcc-88f2-d3cb826eb35d None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:38.814048 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80cec7-46e5-432a-b411-c65d0791fb8e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:38.814048 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80cec7-46e5-432a-b411-c65d0791fb8e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:38.814048 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80cec7-46e5-432a-b411-c65d0791fb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:38.814757 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812e690-1bf7-4fcc-88f2-d3cb826eb35d None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:38.816339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2812e690-1bf7-4fcc-88f2-d3cb826eb35d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:38.818015 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 181/357] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:38 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:38.818784 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812e690-1bf7-4fcc-88f2-d3cb826eb35d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:38.834645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:38.837933 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1f80cec7-46e5-432a-b411-c65d0791fb8e None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:38.839165 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1f80cec7-46e5-432a-b411-c65d0791fb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:38.920326 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 177/358] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:38.921187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80cec7-46e5-432a-b411-c65d0791fb8e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:38.948346 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812e690-1bf7-4fcc-88f2-d3cb826eb35d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:38.994669 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6628-4e45-4c68-8976-8fa1a607b64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:38.995546 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6628-4e45-4c68-8976-8fa1a607b64b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:38.995546 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6628-4e45-4c68-8976-8fa1a607b64b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:38.995761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce6628-4e45-4c68-8976-8fa1a607b64b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:39.015149 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:39.047147 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80cec7-46e5-432a-b411-c65d0791fb8e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:39.095037 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455393f-fe97-4bb0-a87d-a56b3baea208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:39.095584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455393f-fe97-4bb0-a87d-a56b3baea208 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:39.095861 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455393f-fe97-4bb0-a87d-a56b3baea208 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:39.096126 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455393f-fe97-4bb0-a87d-a56b3baea208 None admin] PATH_INFO: `/v3/users/683d81580bda472a885a4e95d670b3df` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:39.097650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce6628-4e45-4c68-8976-8fa1a607b64b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:39.098044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455393f-fe97-4bb0-a87d-a56b3baea208 None admin] RBAC: Authorizing `identity:get_user(user_id=683d81580bda472a885a4e95d670b3df)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:39.099619 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455393f-fe97-4bb0-a87d-a56b3baea208 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:39.099884 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce6628-4e45-4c68-8976-8fa1a607b64b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:39.101399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 178/359] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:11:38 2022] GET /identity/v3/users/683d81580bda472a885a4e95d670b3df => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:39.103236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874946b1-a6a5-4a9e-be07-9959e4551565 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:39.103563 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874946b1-a6a5-4a9e-be07-9959e4551565 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:39.104579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874946b1-a6a5-4a9e-be07-9959e4551565 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:39.109491 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 179/360] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:39.110367 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874946b1-a6a5-4a9e-be07-9959e4551565 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:39.115992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:39.230800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 182/361] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:39.231776 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6628-4e45-4c68-8976-8fa1a607b64b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:39.247024 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874946b1-a6a5-4a9e-be07-9959e4551565 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:39.291001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52e86-7172-40f6-8618-95f0fc38ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:39.291794 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52e86-7172-40f6-8618-95f0fc38ac21 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:39.292086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52e86-7172-40f6-8618-95f0fc38ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:39.292397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c52e86-7172-40f6-8618-95f0fc38ac21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:39.293137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52e86-7172-40f6-8618-95f0fc38ac21 None admin] RBAC: Adding query filter params (group.id=e10f1b6635c1404a89a3bad13758b5c2, role.id=550a417973df4feda528c3e0787c1619, scope.project.id=3d0a846940634bc59ecf00e3124e353c) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:39.293448 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52e86-7172-40f6-8618-95f0fc38ac21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:39.294934 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c52e86-7172-40f6-8618-95f0fc38ac21 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:39.300870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 180/362] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 07:11:39 2022] GET /identity/v3/role_assignments?group.id=e10f1b6635c1404a89a3bad13758b5c2&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=550a417973df4feda528c3e0787c1619 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:39.301918 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52e86-7172-40f6-8618-95f0fc38ac21 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:39.321726 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:39.363787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce6628-4e45-4c68-8976-8fa1a607b64b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:39.376157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:39.419188 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458e45a-3ca6-4aee-872f-ecdcdfc802b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:39.419821 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e45a-3ca6-4aee-872f-ecdcdfc802b8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:39.420102 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e45a-3ca6-4aee-872f-ecdcdfc802b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:39.420375 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458e45a-3ca6-4aee-872f-ecdcdfc802b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:39.421614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458e45a-3ca6-4aee-872f-ecdcdfc802b8 None admin] RBAC: Adding query filter params (group.id=e10f1b6635c1404a89a3bad13758b5c2, role.id=adc491d8d49c47779e572883af3ed47e, scope.project.id=3d0a846940634bc59ecf00e3124e353c) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:39.421929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458e45a-3ca6-4aee-872f-ecdcdfc802b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:39.424102 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458e45a-3ca6-4aee-872f-ecdcdfc802b8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:39.432650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 183/363] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 07:11:39 2022] GET /identity/v3/role_assignments?group.id=e10f1b6635c1404a89a3bad13758b5c2&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=adc491d8d49c47779e572883af3ed47e => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:39.434501 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13853051-c2a3-4438-9ae5-62ed190e3436 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:39.434791 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13853051-c2a3-4438-9ae5-62ed190e3436 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:39.435062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13853051-c2a3-4438-9ae5-62ed190e3436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:39.457677 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-13853051-c2a3-4438-9ae5-62ed190e3436 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:39.458974 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-13853051-c2a3-4438-9ae5-62ed190e3436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:39.460370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c52e86-7172-40f6-8618-95f0fc38ac21 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:39.510287 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebc810-6be0-440a-9b7b-fbece0fbe967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:39.510834 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebc810-6be0-440a-9b7b-fbece0fbe967 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:39.511112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebc810-6be0-440a-9b7b-fbece0fbe967 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:39.511384 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebc810-6be0-440a-9b7b-fbece0fbe967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:39.512315 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebc810-6be0-440a-9b7b-fbece0fbe967 None admin] RBAC: Adding query filter params (role.id=32087f94c45f41e3bee5e95eda599d6f, user.id=683d81580bda472a885a4e95d670b3df, scope.system=all) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:39.512626 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebc810-6be0-440a-9b7b-fbece0fbe967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:39.515408 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ebc810-6be0-440a-9b7b-fbece0fbe967 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:39.531029 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 181/364] 10.222.0.16 () {56 vars in 1308 bytes} [Tue Aug 23 07:11:39 2022] GET /identity/v3/role_assignments?user.id=683d81580bda472a885a4e95d670b3df&scope.system=all&role.id=32087f94c45f41e3bee5e95eda599d6f => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:39.531755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebc810-6be0-440a-9b7b-fbece0fbe967 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:39.560054 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 184/365] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:39.560737 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13853051-c2a3-4438-9ae5-62ed190e3436 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:39.636355 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:39.695833 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13853051-c2a3-4438-9ae5-62ed190e3436 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:39.698868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:39.728774 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebc810-6be0-440a-9b7b-fbece0fbe967 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:39.738588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c4acd-4640-4fab-a318-bf5cc5e674ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:39.739492 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c4acd-4640-4fab-a318-bf5cc5e674ee None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:39.739915 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c4acd-4640-4fab-a318-bf5cc5e674ee None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:39.740330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c4acd-4640-4fab-a318-bf5cc5e674ee None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:39.741704 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c4acd-4640-4fab-a318-bf5cc5e674ee None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:39.743376 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c4acd-4640-4fab-a318-bf5cc5e674ee None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:39.745221 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 185/366] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:39 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:39.750891 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c4acd-4640-4fab-a318-bf5cc5e674ee None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:39.793769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013814b-d608-46bd-91ef-ed0718928a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:39.794308 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013814b-d608-46bd-91ef-ed0718928a6c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:39.795669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013814b-d608-46bd-91ef-ed0718928a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:39.795928 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013814b-d608-46bd-91ef-ed0718928a6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:39.823857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013814b-d608-46bd-91ef-ed0718928a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d013814b-d608-46bd-91ef-ed0718928a6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:39.829478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:39.830623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:39.832363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 182/367] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:39.837379 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013814b-d608-46bd-91ef-ed0718928a6c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:39.889991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c4acd-4640-4fab-a318-bf5cc5e674ee None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:39.929480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797de802-2dba-4dfe-b0d0-8c1da93f490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:39.930512 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797de802-2dba-4dfe-b0d0-8c1da93f490f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:39.930932 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797de802-2dba-4dfe-b0d0-8c1da93f490f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:39.931346 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797de802-2dba-4dfe-b0d0-8c1da93f490f None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:39.932737 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797de802-2dba-4dfe-b0d0-8c1da93f490f None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:39.934401 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797de802-2dba-4dfe-b0d0-8c1da93f490f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:39.936499 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 186/368] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:39 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:39.945783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797de802-2dba-4dfe-b0d0-8c1da93f490f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:40.028927 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013814b-d608-46bd-91ef-ed0718928a6c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:40.051741 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:40.059104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:40.069377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b4e51-6aeb-4086-8f73-f8ff7057eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:40.069377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b4e51-6aeb-4086-8f73-f8ff7057eced None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:40.069377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b4e51-6aeb-4086-8f73-f8ff7057eced None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:40.069377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b4e51-6aeb-4086-8f73-f8ff7057eced None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:40.072371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b4e51-6aeb-4086-8f73-f8ff7057eced None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:40.072371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b4e51-6aeb-4086-8f73-f8ff7057eced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:40.072371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b4e51-6aeb-4086-8f73-f8ff7057eced None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:40.080505 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 183/369] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:40.081253 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b4e51-6aeb-4086-8f73-f8ff7057eced None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:40.115604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797de802-2dba-4dfe-b0d0-8c1da93f490f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:40.161881 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83c3a1-4efc-47e1-ac0b-65bff8abef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:40.162869 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c3a1-4efc-47e1-ac0b-65bff8abef72 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:40.163332 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c3a1-4efc-47e1-ac0b-65bff8abef72 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:40.163748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f83c3a1-4efc-47e1-ac0b-65bff8abef72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:40.164669 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83c3a1-4efc-47e1-ac0b-65bff8abef72 None admin] RBAC: Adding query filter params (group.id=e10f1b6635c1404a89a3bad13758b5c2, role.id=550a417973df4feda528c3e0787c1619, scope.project.id=bc5ad8f68599461690aa33f7d63a0536) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:40.165265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83c3a1-4efc-47e1-ac0b-65bff8abef72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:40.167004 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f83c3a1-4efc-47e1-ac0b-65bff8abef72 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:40.173463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 187/370] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 07:11:39 2022] GET /identity/v3/role_assignments?group.id=e10f1b6635c1404a89a3bad13758b5c2&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=550a417973df4feda528c3e0787c1619 => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:40.174536 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83c3a1-4efc-47e1-ac0b-65bff8abef72 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:40.203830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b4e51-6aeb-4086-8f73-f8ff7057eced None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:40.242641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1af0aa-a2b3-4923-85de-060f1c6aee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:40.243618 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1af0aa-a2b3-4923-85de-060f1c6aee40 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:40.244044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1af0aa-a2b3-4923-85de-060f1c6aee40 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:40.244421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1af0aa-a2b3-4923-85de-060f1c6aee40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:40.259108 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1af0aa-a2b3-4923-85de-060f1c6aee40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-9d1af0aa-a2b3-4923-85de-060f1c6aee40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:40.265606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:40.266684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:40.267456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 184/371] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:11:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:40.275071 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1af0aa-a2b3-4923-85de-060f1c6aee40 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:40.329268 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f83c3a1-4efc-47e1-ac0b-65bff8abef72 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:40.331416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:40.341349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:40.400230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e51c80-a93b-44aa-9976-6d0cbff2d056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:40.401272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e51c80-a93b-44aa-9976-6d0cbff2d056 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:40.401747 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e51c80-a93b-44aa-9976-6d0cbff2d056 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:40.402236 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e51c80-a93b-44aa-9976-6d0cbff2d056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:40.413186 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1af0aa-a2b3-4923-85de-060f1c6aee40 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:40.463816 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244558c5-bf5b-4dfe-b21b-b25f8c6b7def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:40.464847 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244558c5-bf5b-4dfe-b21b-b25f8c6b7def None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:40.465134 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244558c5-bf5b-4dfe-b21b-b25f8c6b7def None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:40.465410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244558c5-bf5b-4dfe-b21b-b25f8c6b7def None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:40.466084 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244558c5-bf5b-4dfe-b21b-b25f8c6b7def None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:40.466409 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244558c5-bf5b-4dfe-b21b-b25f8c6b7def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:40.468409 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244558c5-bf5b-4dfe-b21b-b25f8c6b7def None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:40.484685 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 185/372] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:40.491023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244558c5-bf5b-4dfe-b21b-b25f8c6b7def None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:40.522336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e51c80-a93b-44aa-9976-6d0cbff2d056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:40.523774 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e51c80-a93b-44aa-9976-6d0cbff2d056 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:40.687439 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244558c5-bf5b-4dfe-b21b-b25f8c6b7def None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:40.701290 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:40.732469 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 188/373] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:40.738832 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad1dc4-2b4c-4ce9-9b5a-755aebd5dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:40.739130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e51c80-a93b-44aa-9976-6d0cbff2d056 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:40.739460 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1dc4-2b4c-4ce9-9b5a-755aebd5dcd7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:40.739743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1dc4-2b4c-4ce9-9b5a-755aebd5dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:40.740019 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1dc4-2b4c-4ce9-9b5a-755aebd5dcd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:40.750449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:40.854303 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad1dc4-2b4c-4ce9-9b5a-755aebd5dcd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:40.855688 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad1dc4-2b4c-4ce9-9b5a-755aebd5dcd7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:40.923748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e51c80-a93b-44aa-9976-6d0cbff2d056 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:40.983019 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c820-e023-42d0-b956-494846d4aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:40.983468 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c820-e023-42d0-b956-494846d4aed4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:40.983743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c820-e023-42d0-b956-494846d4aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:40.984011 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c820-e023-42d0-b956-494846d4aed4 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:40.985213 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666c820-e023-42d0-b956-494846d4aed4 None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:40.986666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666c820-e023-42d0-b956-494846d4aed4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:40.989379 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 189/374] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:40 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:40.995019 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c820-e023-42d0-b956-494846d4aed4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:40.998734 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 186/375] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:41.004316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad1dc4-2b4c-4ce9-9b5a-755aebd5dcd7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:41.027515 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:41.106543 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:41.136507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad1dc4-2b4c-4ce9-9b5a-755aebd5dcd7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:41.161959 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c820-e023-42d0-b956-494846d4aed4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:41.205425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6821e7-af72-4920-b0d1-4a52651562f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:41.206065 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6821e7-af72-4920-b0d1-4a52651562f9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:41.207118 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6821e7-af72-4920-b0d1-4a52651562f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:41.207649 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6821e7-af72-4920-b0d1-4a52651562f9 None admin] PATH_INFO: `/v3/projects/446e3fa3333244a786f2fbb60ab9e0a2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:41.209425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6821e7-af72-4920-b0d1-4a52651562f9 None admin] RBAC: Authorizing `identity:get_project(project_id=446e3fa3333244a786f2fbb60ab9e0a2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:41.213109 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6821e7-af72-4920-b0d1-4a52651562f9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:41.214829 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 187/376] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:41 2022] GET /identity/v3/projects/446e3fa3333244a786f2fbb60ab9e0a2 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:41.221255 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6821e7-af72-4920-b0d1-4a52651562f9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:41.226411 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68acf1-24b1-453e-adf8-d7b628d1a69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:41.227057 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68acf1-24b1-453e-adf8-d7b628d1a69a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:41.227337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68acf1-24b1-453e-adf8-d7b628d1a69a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:41.227612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac68acf1-24b1-453e-adf8-d7b628d1a69a None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:41.231594 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68acf1-24b1-453e-adf8-d7b628d1a69a None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:41.233046 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac68acf1-24b1-453e-adf8-d7b628d1a69a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:41.234667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 190/377] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:40 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:41.241644 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68acf1-24b1-453e-adf8-d7b628d1a69a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:41.354492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:41.382618 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6821e7-af72-4920-b0d1-4a52651562f9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:41.421986 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a88a67-ecfe-4134-8f9c-33e78f9f3231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:41.422664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a88a67-ecfe-4134-8f9c-33e78f9f3231 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:41.422947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a88a67-ecfe-4134-8f9c-33e78f9f3231 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:41.423223 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a88a67-ecfe-4134-8f9c-33e78f9f3231 None admin] PATH_INFO: `/v3/groups/4013098f76734858b365cb2af26d5af8` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:41.425998 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac68acf1-24b1-453e-adf8-d7b628d1a69a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:41.435212 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a88a67-ecfe-4134-8f9c-33e78f9f3231 None admin] RBAC: Authorizing `identity:get_group(group_id=4013098f76734858b365cb2af26d5af8)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:41.438971 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a88a67-ecfe-4134-8f9c-33e78f9f3231 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:41.440717 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 188/378] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:41 2022] GET /identity/v3/groups/4013098f76734858b365cb2af26d5af8 => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:41.447208 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a88a67-ecfe-4134-8f9c-33e78f9f3231 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:41.499082 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b274e8d-2f23-4d4f-884d-56de17e33515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:41.499703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b274e8d-2f23-4d4f-884d-56de17e33515 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:41.499981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b274e8d-2f23-4d4f-884d-56de17e33515 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:41.500254 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b274e8d-2f23-4d4f-884d-56de17e33515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:41.500988 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b274e8d-2f23-4d4f-884d-56de17e33515 None admin] RBAC: Adding query filter params (group.id=e10f1b6635c1404a89a3bad13758b5c2, role.id=adc491d8d49c47779e572883af3ed47e, scope.project.id=bc5ad8f68599461690aa33f7d63a0536) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:41.501296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b274e8d-2f23-4d4f-884d-56de17e33515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:41.502761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b274e8d-2f23-4d4f-884d-56de17e33515 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:41.516501 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 191/379] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 07:11:41 2022] GET /identity/v3/role_assignments?group.id=e10f1b6635c1404a89a3bad13758b5c2&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=adc491d8d49c47779e572883af3ed47e => generated 260 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:41.593275 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a88a67-ecfe-4134-8f9c-33e78f9f3231 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:41.633282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff7b92-07ad-4db9-93e7-98de44ea7da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:41.633815 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff7b92-07ad-4db9-93e7-98de44ea7da2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:41.634111 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff7b92-07ad-4db9-93e7-98de44ea7da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:41.634404 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff7b92-07ad-4db9-93e7-98de44ea7da2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:41.635137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff7b92-07ad-4db9-93e7-98de44ea7da2 None admin] RBAC: Adding query filter params (group.id=4013098f76734858b365cb2af26d5af8, role.id=afe88bc03d30494b89892587177c79de, scope.project.id=446e3fa3333244a786f2fbb60ab9e0a2) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:41.635448 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff7b92-07ad-4db9-93e7-98de44ea7da2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:41.637014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff7b92-07ad-4db9-93e7-98de44ea7da2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:41.643564 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 189/380] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 07:11:41 2022] GET /identity/v3/role_assignments?group.id=4013098f76734858b365cb2af26d5af8&scope.project.id=446e3fa3333244a786f2fbb60ab9e0a2&role.id=afe88bc03d30494b89892587177c79de => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:41.800913 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0675db-f1af-4549-b20b-45e64c95108d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:41.801561 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0675db-f1af-4549-b20b-45e64c95108d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:41.801561 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0675db-f1af-4549-b20b-45e64c95108d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:41.803279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 192/381] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:41.809464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7d4dc-dc1f-4218-a104-2c74b36e5243 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:41.809739 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7d4dc-dc1f-4218-a104-2c74b36e5243 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:41.810015 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7d4dc-dc1f-4218-a104-2c74b36e5243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:41.832250 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-aac7d4dc-dc1f-4218-a104-2c74b36e5243 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:41.833641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-aac7d4dc-dc1f-4218-a104-2c74b36e5243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:41.835895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:41.912466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 190/382] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:42.163459 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed047cb-b42e-4cc1-9c34-e153bf85f1a9 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:42.163817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed047cb-b42e-4cc1-9c34-e153bf85f1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:42.163918 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed047cb-b42e-4cc1-9c34-e153bf85f1a9 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:42.165401 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 193/383] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:42.171019 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69c085-aebb-4c3e-a30a-8a8646fde5ee None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:42.171304 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69c085-aebb-4c3e-a30a-8a8646fde5ee None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:42.171577 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69c085-aebb-4c3e-a30a-8a8646fde5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:42.196056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-3c69c085-aebb-4c3e-a30a-8a8646fde5ee None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:42.197441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-3c69c085-aebb-4c3e-a30a-8a8646fde5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:42.282843 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 191/384] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:42.403633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed047cb-b42e-4cc1-9c34-e153bf85f1a9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:42.406585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:42.530477 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed047cb-b42e-4cc1-9c34-e153bf85f1a9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:42.574920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d22e2c-8c01-45cb-952f-a63cdeb7bcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:42.575563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d22e2c-8c01-45cb-952f-a63cdeb7bcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:42.575844 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d22e2c-8c01-45cb-952f-a63cdeb7bcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:42.576173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d22e2c-8c01-45cb-952f-a63cdeb7bcb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:42.591045 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d22e2c-8c01-45cb-952f-a63cdeb7bcb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-80d22e2c-8c01-45cb-952f-a63cdeb7bcb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:42.596210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:42.597129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:42.597917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 194/385] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:42.603315 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69c085-aebb-4c3e-a30a-8a8646fde5ee None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:42.624053 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d22e2c-8c01-45cb-952f-a63cdeb7bcb5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:42.723674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:42.746452 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:42.794859 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69c085-aebb-4c3e-a30a-8a8646fde5ee None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:42.818581 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d22e2c-8c01-45cb-952f-a63cdeb7bcb5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:42.863314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb561fd-314a-4609-b131-78ee73e5e3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:42.864091 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb561fd-314a-4609-b131-78ee73e5e3eb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:42.864370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb561fd-314a-4609-b131-78ee73e5e3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:42.864632 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb561fd-314a-4609-b131-78ee73e5e3eb None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:42.865301 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb561fd-314a-4609-b131-78ee73e5e3eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:42.865598 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb561fd-314a-4609-b131-78ee73e5e3eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:42.866976 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb561fd-314a-4609-b131-78ee73e5e3eb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:42.884051 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 192/386] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:42.890484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f09b91-0ba8-4322-b7d9-4252ed38c13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:42.891126 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09b91-0ba8-4322-b7d9-4252ed38c13e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:42.891400 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09b91-0ba8-4322-b7d9-4252ed38c13e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:42.891678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f09b91-0ba8-4322-b7d9-4252ed38c13e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:42.892978 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb561fd-314a-4609-b131-78ee73e5e3eb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:42.915172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f09b91-0ba8-4322-b7d9-4252ed38c13e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-49f09b91-0ba8-4322-b7d9-4252ed38c13e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:42.919990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:42.920861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:42.921777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 195/387] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:42.922539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb0fe-1680-4259-a817-5367e100efbd None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:42.922827 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb0fe-1680-4259-a817-5367e100efbd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:42.923103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcb0fe-1680-4259-a817-5367e100efbd None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:42.929183 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 196/388] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:42.930379 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9e480-b1a6-44ce-825d-1a51105aae6e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:42.930663 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9e480-b1a6-44ce-825d-1a51105aae6e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:42.930937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9e480-b1a6-44ce-825d-1a51105aae6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:42.950632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6ab9e480-b1a6-44ce-825d-1a51105aae6e None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:42.951828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6ab9e480-b1a6-44ce-825d-1a51105aae6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:43.027825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 197/389] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:43.028709 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9e480-b1a6-44ce-825d-1a51105aae6e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:43.036900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb561fd-314a-4609-b131-78ee73e5e3eb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:43.084728 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:43.087940 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:43.106774 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59819-7b0f-4e7a-a4bb-fbb86df3f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:43.107413 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59819-7b0f-4e7a-a4bb-fbb86df3f67b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:43.107695 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59819-7b0f-4e7a-a4bb-fbb86df3f67b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:43.107968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c59819-7b0f-4e7a-a4bb-fbb86df3f67b None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:43.109132 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59819-7b0f-4e7a-a4bb-fbb86df3f67b None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:43.110614 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c59819-7b0f-4e7a-a4bb-fbb86df3f67b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:43.113397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 193/390] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:42 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:43.119436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59819-7b0f-4e7a-a4bb-fbb86df3f67b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:43.134624 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9e480-b1a6-44ce-825d-1a51105aae6e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:43.197230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704598a-7397-41c1-b6ef-2b9244d62ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:43.197831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704598a-7397-41c1-b6ef-2b9244d62ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:43.198157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704598a-7397-41c1-b6ef-2b9244d62ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:43.198408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704598a-7397-41c1-b6ef-2b9244d62ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:43.199080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704598a-7397-41c1-b6ef-2b9244d62ad3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:43.199381 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704598a-7397-41c1-b6ef-2b9244d62ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:43.200753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704598a-7397-41c1-b6ef-2b9244d62ad3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:43.214690 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 198/391] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:43.224584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704598a-7397-41c1-b6ef-2b9244d62ad3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:43.289709 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c59819-7b0f-4e7a-a4bb-fbb86df3f67b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:43.340476 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704598a-7397-41c1-b6ef-2b9244d62ad3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:43.358486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:43.376830 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f67c2-c1d8-47ad-818a-7ebeab0dd020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:43.377469 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f67c2-c1d8-47ad-818a-7ebeab0dd020 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:43.377755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f67c2-c1d8-47ad-818a-7ebeab0dd020 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:43.378186 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f67c2-c1d8-47ad-818a-7ebeab0dd020 None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:43.379328 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f67c2-c1d8-47ad-818a-7ebeab0dd020 None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:43.380781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053f67c2-c1d8-47ad-818a-7ebeab0dd020 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:43.382154 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cfc42-383d-441a-bc81-9774f6cea164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:43.382690 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 199/392] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:43 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:43.382994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cfc42-383d-441a-bc81-9774f6cea164 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:43.383342 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cfc42-383d-441a-bc81-9774f6cea164 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:43.386376 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1cfc42-383d-441a-bc81-9774f6cea164 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:43.387747 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cfc42-383d-441a-bc81-9774f6cea164 None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:43.388710 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f67c2-c1d8-47ad-818a-7ebeab0dd020 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:43.390793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1cfc42-383d-441a-bc81-9774f6cea164 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:43.392638 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 194/393] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:43 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:43.397452 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cfc42-383d-441a-bc81-9774f6cea164 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:43.481554 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:43.506456 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f67c2-c1d8-47ad-818a-7ebeab0dd020 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:43.526674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1cfc42-383d-441a-bc81-9774f6cea164 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:43.562127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad98ac7-ac3c-4cc4-a1d5-87996f2867a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:43.562127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad98ac7-ac3c-4cc4-a1d5-87996f2867a3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:43.562127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad98ac7-ac3c-4cc4-a1d5-87996f2867a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:43.562127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad98ac7-ac3c-4cc4-a1d5-87996f2867a3 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:43.562562 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad98ac7-ac3c-4cc4-a1d5-87996f2867a3 None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:43.562562 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad98ac7-ac3c-4cc4-a1d5-87996f2867a3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:43.562562 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 200/394] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:43 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:43.562562 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad98ac7-ac3c-4cc4-a1d5-87996f2867a3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:43.573337 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1714a-4907-440f-920f-8c2045df5212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:43.573799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1714a-4907-440f-920f-8c2045df5212 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:43.574081 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1714a-4907-440f-920f-8c2045df5212 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:43.574384 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f1714a-4907-440f-920f-8c2045df5212 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:43.597285 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f1714a-4907-440f-920f-8c2045df5212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-17f1714a-4907-440f-920f-8c2045df5212 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:43.603090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:43.603994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 195/395] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:43.604791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1714a-4907-440f-920f-8c2045df5212 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:43.642510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:43.695900 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad98ac7-ac3c-4cc4-a1d5-87996f2867a3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:43.713502 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f1714a-4907-440f-920f-8c2045df5212 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:43.742767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:43.743125 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9c69c-d7da-4df5-b5c8-b6c44777d1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:43.744748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9c69c-d7da-4df5-b5c8-b6c44777d1d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:43.745521 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9c69c-d7da-4df5-b5c8-b6c44777d1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:43.745995 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9c69c-d7da-4df5-b5c8-b6c44777d1d3 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c/groups/e10f1b6635c1404a89a3bad13758b5c2/roles/550a417973df4feda528c3e0787c1619` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:43.749034 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9c69c-d7da-4df5-b5c8-b6c44777d1d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d0a846940634bc59ecf00e3124e353c, group_id=e10f1b6635c1404a89a3bad13758b5c2, role_id=550a417973df4feda528c3e0787c1619)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:43.750715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9c69c-d7da-4df5-b5c8-b6c44777d1d3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:43.752348 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb6475-02b4-4df6-a92b-f14b6771b574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:43.753617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6475-02b4-4df6-a92b-f14b6771b574 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:43.753922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6475-02b4-4df6-a92b-f14b6771b574 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:43.754369 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb6475-02b4-4df6-a92b-f14b6771b574 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c/groups/e10f1b6635c1404a89a3bad13758b5c2/roles/adc491d8d49c47779e572883af3ed47e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:43.756791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb6475-02b4-4df6-a92b-f14b6771b574 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d0a846940634bc59ecf00e3124e353c, group_id=e10f1b6635c1404a89a3bad13758b5c2, role_id=adc491d8d49c47779e572883af3ed47e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:43.758556 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb6475-02b4-4df6-a92b-f14b6771b574 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:43.834228 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 201/396] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 23 07:11:43 2022] PUT /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c/groups/e10f1b6635c1404a89a3bad13758b5c2/roles/550a417973df4feda528c3e0787c1619 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:43.834861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9c69c-d7da-4df5-b5c8-b6c44777d1d3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:43.864161 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 196/397] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 23 07:11:43 2022] PUT /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c/groups/e10f1b6635c1404a89a3bad13758b5c2/roles/adc491d8d49c47779e572883af3ed47e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:43.986484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9c69c-d7da-4df5-b5c8-b6c44777d1d3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:43.999825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:44.029481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d474aaf-bea2-42ea-8f31-f6e93f4e0b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:44.030207 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d474aaf-bea2-42ea-8f31-f6e93f4e0b1f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:44.030487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d474aaf-bea2-42ea-8f31-f6e93f4e0b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:44.030755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d474aaf-bea2-42ea-8f31-f6e93f4e0b1f None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:44.031542 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d474aaf-bea2-42ea-8f31-f6e93f4e0b1f None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:44.031877 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d474aaf-bea2-42ea-8f31-f6e93f4e0b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:44.033282 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d474aaf-bea2-42ea-8f31-f6e93f4e0b1f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:44.045094 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 202/398] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:44.050869 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7a85-491a-4a99-96e3-096a716943cb None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:44.051343 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7a85-491a-4a99-96e3-096a716943cb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:44.051343 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a7a85-491a-4a99-96e3-096a716943cb None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:44.052753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d474aaf-bea2-42ea-8f31-f6e93f4e0b1f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:44.052861 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 197/399] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:11:44.058181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d541de0-c76f-43a3-88f4-ac18a1a61fdb None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:44.058497 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d541de0-c76f-43a3-88f4-ac18a1a61fdb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:44.058800 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d541de0-c76f-43a3-88f4-ac18a1a61fdb None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:44.060343 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 198/400] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:44.061513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc957b-3aeb-44b4-a893-5227be3c84e8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:44.061793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc957b-3aeb-44b4-a893-5227be3c84e8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:44.062065 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc957b-3aeb-44b4-a893-5227be3c84e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:44.088655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c3bc957b-3aeb-44b4-a893-5227be3c84e8 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:44.089848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c3bc957b-3aeb-44b4-a893-5227be3c84e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:44.166487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 199/401] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:44.167892 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c13e94-9c1d-4fb6-bb02-ded2b02ccae0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:44.173069 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d474aaf-bea2-42ea-8f31-f6e93f4e0b1f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:44.174465 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c13e94-9c1d-4fb6-bb02-ded2b02ccae0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:44.175076 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c13e94-9c1d-4fb6-bb02-ded2b02ccae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:44.205322 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f4c13e94-9c1d-4fb6-bb02-ded2b02ccae0 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:44.207309 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f4c13e94-9c1d-4fb6-bb02-ded2b02ccae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:44.217318 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c0e9-0b1f-4471-a720-694711390545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:44.218228 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c0e9-0b1f-4471-a720-694711390545 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:44.219005 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c0e9-0b1f-4471-a720-694711390545 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:44.220541 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1c0e9-0b1f-4471-a720-694711390545 None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:44.222055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c0e9-0b1f-4471-a720-694711390545 None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:44.224058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1c0e9-0b1f-4471-a720-694711390545 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:44.226633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 203/402] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:44 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:44.234693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c0e9-0b1f-4471-a720-694711390545 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:44.284823 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:44.355206 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1c0e9-0b1f-4471-a720-694711390545 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:44.383037 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 200/403] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:44.397610 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022448c-510f-4f0a-aab3-6983958f3309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:44.398237 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022448c-510f-4f0a-aab3-6983958f3309 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:44.398516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022448c-510f-4f0a-aab3-6983958f3309 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:44.398787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022448c-510f-4f0a-aab3-6983958f3309 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:44.399913 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022448c-510f-4f0a-aab3-6983958f3309 None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:44.401334 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022448c-510f-4f0a-aab3-6983958f3309 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:44.407635 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 204/404] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:44 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:44.408846 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c13e94-9c1d-4fb6-bb02-ded2b02ccae0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:44.483248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:44.551575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022448c-510f-4f0a-aab3-6983958f3309 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:44.577213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c13e94-9c1d-4fb6-bb02-ded2b02ccae0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:44.657149 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af568f7b-98bd-4b43-98f6-3fe7ab875651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:44.657820 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af568f7b-98bd-4b43-98f6-3fe7ab875651 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:44.658093 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af568f7b-98bd-4b43-98f6-3fe7ab875651 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:44.658386 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af568f7b-98bd-4b43-98f6-3fe7ab875651 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536/groups/e10f1b6635c1404a89a3bad13758b5c2/roles/550a417973df4feda528c3e0787c1619` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:44.660631 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af568f7b-98bd-4b43-98f6-3fe7ab875651 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc5ad8f68599461690aa33f7d63a0536, group_id=e10f1b6635c1404a89a3bad13758b5c2, role_id=550a417973df4feda528c3e0787c1619)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:44.662075 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af568f7b-98bd-4b43-98f6-3fe7ab875651 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:44.705132 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022448c-510f-4f0a-aab3-6983958f3309 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:44.716758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:44.742789 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc137-fe2b-4d6b-b3f1-fb99025bba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:44.743394 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc137-fe2b-4d6b-b3f1-fb99025bba62 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:44.743676 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc137-fe2b-4d6b-b3f1-fb99025bba62 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:44.743946 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc137-fe2b-4d6b-b3f1-fb99025bba62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:44.755609 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6cc137-fe2b-4d6b-b3f1-fb99025bba62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:44.760775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 201/405] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 23 07:11:44 2022] PUT /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536/groups/e10f1b6635c1404a89a3bad13758b5c2/roles/550a417973df4feda528c3e0787c1619 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2f6cc137-fe2b-4d6b-b3f1-fb99025bba62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:44.761241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:44.772554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:44.773578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 205/406] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:11:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:44.774371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af568f7b-98bd-4b43-98f6-3fe7ab875651 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:44.774442 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc137-fe2b-4d6b-b3f1-fb99025bba62 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:44.885030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af568f7b-98bd-4b43-98f6-3fe7ab875651 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:44.891143 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6cc137-fe2b-4d6b-b3f1-fb99025bba62 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:44.893047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:44.923103 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd99fe0-d8fb-4b6f-bda6-2deeee0fb0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:44.927133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99fe0-d8fb-4b6f-bda6-2deeee0fb0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:44.927466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99fe0-d8fb-4b6f-bda6-2deeee0fb0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:44.929409 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd99fe0-d8fb-4b6f-bda6-2deeee0fb0e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:44.933045 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50aacb4-c535-4eac-90e0-9a41d2abe0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:44.933956 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aacb4-c535-4eac-90e0-9a41d2abe0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:44.934453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aacb4-c535-4eac-90e0-9a41d2abe0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:44.934920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50aacb4-c535-4eac-90e0-9a41d2abe0d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:44.935863 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50aacb4-c535-4eac-90e0-9a41d2abe0d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:44.945332 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50aacb4-c535-4eac-90e0-9a41d2abe0d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:44.945332 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50aacb4-c535-4eac-90e0-9a41d2abe0d2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:44.945733 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd99fe0-d8fb-4b6f-bda6-2deeee0fb0e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3cd99fe0-d8fb-4b6f-bda6-2deeee0fb0e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:44.947826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:44.948713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:44.949932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 202/407] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:44.954983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 206/408] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:44.955242 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd99fe0-d8fb-4b6f-bda6-2deeee0fb0e1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:44.969400 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50aacb4-c535-4eac-90e0-9a41d2abe0d2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:45.027095 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:45.081468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd99fe0-d8fb-4b6f-bda6-2deeee0fb0e1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:45.130436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cf233-842b-4be4-8c19-4f2ea8fab5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:45.131044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cf233-842b-4be4-8c19-4f2ea8fab5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:45.131489 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cf233-842b-4be4-8c19-4f2ea8fab5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:45.131930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574cf233-842b-4be4-8c19-4f2ea8fab5d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:45.132600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cf233-842b-4be4-8c19-4f2ea8fab5d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:45.132897 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cf233-842b-4be4-8c19-4f2ea8fab5d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:45.134280 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574cf233-842b-4be4-8c19-4f2ea8fab5d1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:45.144050 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 203/409] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:45.149821 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cf233-842b-4be4-8c19-4f2ea8fab5d1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:45.160104 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50aacb4-c535-4eac-90e0-9a41d2abe0d2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:45.180311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:45.250865 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dbb22-c537-4f95-b8b9-861f60b55ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:45.251573 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dbb22-c537-4f95-b8b9-861f60b55ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:45.251860 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dbb22-c537-4f95-b8b9-861f60b55ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:45.252151 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dbb22-c537-4f95-b8b9-861f60b55ca9 None admin] PATH_INFO: `/v3/groups/4013098f76734858b365cb2af26d5af8` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:45.253928 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dbb22-c537-4f95-b8b9-861f60b55ca9 None admin] RBAC: Authorizing `identity:get_group(group_id=4013098f76734858b365cb2af26d5af8)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:45.255418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dbb22-c537-4f95-b8b9-861f60b55ca9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:45.257302 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 207/410] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:44 2022] GET /identity/v3/groups/4013098f76734858b365cb2af26d5af8 => generated 229 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:45.265224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574cf233-842b-4be4-8c19-4f2ea8fab5d1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:45.273928 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dbb22-c537-4f95-b8b9-861f60b55ca9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:45.306367 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48717b77-75f0-482c-871a-25aed43cedd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:45.307272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717b77-75f0-482c-871a-25aed43cedd2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:45.307687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717b77-75f0-482c-871a-25aed43cedd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:45.308094 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48717b77-75f0-482c-871a-25aed43cedd2 None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:45.309398 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48717b77-75f0-482c-871a-25aed43cedd2 None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:45.311048 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48717b77-75f0-482c-871a-25aed43cedd2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:45.312900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 204/411] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:45 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:45.320499 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48717b77-75f0-482c-871a-25aed43cedd2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:45.461487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:45.467755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dbb22-c537-4f95-b8b9-861f60b55ca9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:45.470467 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:45.481729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48717b77-75f0-482c-871a-25aed43cedd2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:45.530378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf2277-23e5-4912-9f42-541512ad082e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:45.531714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf2277-23e5-4912-9f42-541512ad082e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:45.532580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf2277-23e5-4912-9f42-541512ad082e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:45.533396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf2277-23e5-4912-9f42-541512ad082e None admin] PATH_INFO: `/v3/projects/446e3fa3333244a786f2fbb60ab9e0a2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:45.535766 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf2277-23e5-4912-9f42-541512ad082e None admin] RBAC: Authorizing `identity:get_project(project_id=446e3fa3333244a786f2fbb60ab9e0a2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:45.538257 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88378a-a024-4021-b82c-72100446e95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:45.538257 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88378a-a024-4021-b82c-72100446e95d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:45.538257 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88378a-a024-4021-b82c-72100446e95d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:45.538257 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88378a-a024-4021-b82c-72100446e95d None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:45.540511 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf2277-23e5-4912-9f42-541512ad082e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:45.541275 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88378a-a024-4021-b82c-72100446e95d None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:45.542853 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88378a-a024-4021-b82c-72100446e95d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:45.544676 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 208/412] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:45 2022] GET /identity/v3/projects/446e3fa3333244a786f2fbb60ab9e0a2 => generated 344 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:45.546908 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 205/413] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:45 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:45.552701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf2277-23e5-4912-9f42-541512ad082e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:45.554091 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88378a-a024-4021-b82c-72100446e95d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:45.701916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88378a-a024-4021-b82c-72100446e95d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:45.751782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb11ebb6-41a9-4a0a-9251-3b6927c1dd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:45.752761 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ebb6-41a9-4a0a-9251-3b6927c1dd3c None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:45.753192 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ebb6-41a9-4a0a-9251-3b6927c1dd3c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:45.753658 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb11ebb6-41a9-4a0a-9251-3b6927c1dd3c None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536/groups/e10f1b6635c1404a89a3bad13758b5c2/roles/adc491d8d49c47779e572883af3ed47e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:45.758429 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11ebb6-41a9-4a0a-9251-3b6927c1dd3c None admin] RBAC: Authorizing `identity:create_grant(project_id=bc5ad8f68599461690aa33f7d63a0536, group_id=e10f1b6635c1404a89a3bad13758b5c2, role_id=adc491d8d49c47779e572883af3ed47e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:45.760102 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb11ebb6-41a9-4a0a-9251-3b6927c1dd3c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:45.787621 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf2277-23e5-4912-9f42-541512ad082e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:45.825375 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09911e9a-9468-4102-a1cc-86d8a197a0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:45.826322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09911e9a-9468-4102-a1cc-86d8a197a0f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:45.826781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09911e9a-9468-4102-a1cc-86d8a197a0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:45.827209 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09911e9a-9468-4102-a1cc-86d8a197a0f9 None admin] PATH_INFO: `/v3/projects/446e3fa3333244a786f2fbb60ab9e0a2/groups/4013098f76734858b365cb2af26d5af8/roles/afe88bc03d30494b89892587177c79de` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:45.829401 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09911e9a-9468-4102-a1cc-86d8a197a0f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=446e3fa3333244a786f2fbb60ab9e0a2, group_id=4013098f76734858b365cb2af26d5af8, role_id=afe88bc03d30494b89892587177c79de)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:45.831662 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09911e9a-9468-4102-a1cc-86d8a197a0f9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:45.868759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 206/414] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 23 07:11:45 2022] PUT /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536/groups/e10f1b6635c1404a89a3bad13758b5c2/roles/adc491d8d49c47779e572883af3ed47e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:45.920279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 209/415] 10.222.0.16 () {58 vars in 1442 bytes} [Tue Aug 23 07:11:45 2022] PUT /identity/v3/projects/446e3fa3333244a786f2fbb60ab9e0a2/groups/4013098f76734858b365cb2af26d5af8/roles/afe88bc03d30494b89892587177c79de => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:11:46.163649 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7980a-881c-4ec3-92f5-f9e90275b287 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:46.164180 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7980a-881c-4ec3-92f5-f9e90275b287 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:46.164180 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7980a-881c-4ec3-92f5-f9e90275b287 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:46.165653 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 207/416] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:46.171166 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6998-f882-4478-8d84-87da1ae828fa None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:46.171457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6998-f882-4478-8d84-87da1ae828fa None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:46.171727 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de6998-f882-4478-8d84-87da1ae828fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:46.199164 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c8de6998-f882-4478-8d84-87da1ae828fa None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:46.200400 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c8de6998-f882-4478-8d84-87da1ae828fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:46.227434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:46.267329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57acba6-2842-4085-b3e4-d42bd892577a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:46.268119 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57acba6-2842-4085-b3e4-d42bd892577a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:46.268719 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57acba6-2842-4085-b3e4-d42bd892577a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:46.270997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 208/417] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:46.277649 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcfeeb-2fd6-4705-b97d-38720d43c854 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:46.277937 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcfeeb-2fd6-4705-b97d-38720d43c854 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:46.278419 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcfeeb-2fd6-4705-b97d-38720d43c854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:46.288499 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 210/418] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:46.303651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c6fcfeeb-2fd6-4705-b97d-38720d43c854 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:46.305108 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c6fcfeeb-2fd6-4705-b97d-38720d43c854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:46.334796 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:46.408382 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 209/419] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:46.670862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de6998-f882-4478-8d84-87da1ae828fa None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:46.797278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcfeeb-2fd6-4705-b97d-38720d43c854 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:46.800626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de6998-f882-4478-8d84-87da1ae828fa None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:46.837896 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd8020-8acc-44bc-9888-db34bdf17e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:46.838478 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd8020-8acc-44bc-9888-db34bdf17e48 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:46.838758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd8020-8acc-44bc-9888-db34bdf17e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:46.839032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd8020-8acc-44bc-9888-db34bdf17e48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:46.861683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd8020-8acc-44bc-9888-db34bdf17e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2acd8020-8acc-44bc-9888-db34bdf17e48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:46.866726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:46.867629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:46.868443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 211/420] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:46.875092 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd8020-8acc-44bc-9888-db34bdf17e48 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:46.904177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:46.965706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcfeeb-2fd6-4705-b97d-38720d43c854 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:47.040072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd8020-8acc-44bc-9888-db34bdf17e48 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:47.058810 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07907d9c-1911-41e9-892b-d7dd0956f0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:47.059457 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07907d9c-1911-41e9-892b-d7dd0956f0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:47.059739 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07907d9c-1911-41e9-892b-d7dd0956f0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:47.060011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07907d9c-1911-41e9-892b-d7dd0956f0a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:47.083784 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466a408-7fbc-41f0-8274-6c88c503b82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:47.084713 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466a408-7fbc-41f0-8274-6c88c503b82e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:47.085337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466a408-7fbc-41f0-8274-6c88c503b82e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:47.085810 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466a408-7fbc-41f0-8274-6c88c503b82e None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:47.086685 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466a408-7fbc-41f0-8274-6c88c503b82e None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:47.087196 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466a408-7fbc-41f0-8274-6c88c503b82e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:47.088802 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466a408-7fbc-41f0-8274-6c88c503b82e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:47.090981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07907d9c-1911-41e9-892b-d7dd0956f0a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-07907d9c-1911-41e9-892b-d7dd0956f0a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:47.096124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:47.097529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:47.098356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:47.102638 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 212/421] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:47.108545 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 210/422] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:47.108545 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07907d9c-1911-41e9-892b-d7dd0956f0a0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:47.114447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466a408-7fbc-41f0-8274-6c88c503b82e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:47.153381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:47.203617 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:47.226798 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466a408-7fbc-41f0-8274-6c88c503b82e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:47.255462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07907d9c-1911-41e9-892b-d7dd0956f0a0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:47.267194 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc6651-03b7-4ee0-a3ca-adaf4e47cb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:47.267841 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6651-03b7-4ee0-a3ca-adaf4e47cb88 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:47.268122 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6651-03b7-4ee0-a3ca-adaf4e47cb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:47.268438 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc6651-03b7-4ee0-a3ca-adaf4e47cb88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:47.298685 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a92c0e-fb5e-4c6e-bfdb-2da04ef9fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:47.300913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a92c0e-fb5e-4c6e-bfdb-2da04ef9fa48 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:47.301572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a92c0e-fb5e-4c6e-bfdb-2da04ef9fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:47.302058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a92c0e-fb5e-4c6e-bfdb-2da04ef9fa48 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:47.303179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a92c0e-fb5e-4c6e-bfdb-2da04ef9fa48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:47.303719 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a92c0e-fb5e-4c6e-bfdb-2da04ef9fa48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:47.305391 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a92c0e-fb5e-4c6e-bfdb-2da04ef9fa48 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:47.321715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 211/423] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:47.323696 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765008a4-4417-4168-a657-0893bcbd645f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:47.324277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765008a4-4417-4168-a657-0893bcbd645f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:47.324789 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765008a4-4417-4168-a657-0893bcbd645f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:47.326585 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 212/424] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:47.327467 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765008a4-4417-4168-a657-0893bcbd645f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:47.351080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc6651-03b7-4ee0-a3ca-adaf4e47cb88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:47.352457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc6651-03b7-4ee0-a3ca-adaf4e47cb88 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:47.417377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:47.433976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:47.443596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765008a4-4417-4168-a657-0893bcbd645f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:47.460121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 213/425] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 07:11:47.460121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566c2c8-363f-464e-9b0f-da31116dfe7e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:47.460121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566c2c8-363f-464e-9b0f-da31116dfe7e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:47.460121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566c2c8-363f-464e-9b0f-da31116dfe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:47.479655 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5566c2c8-363f-464e-9b0f-da31116dfe7e None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:47.480756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5566c2c8-363f-464e-9b0f-da31116dfe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:47.487683 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c7d3d-f07e-424f-b3ec-eda6bb57da1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:47.488594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c7d3d-f07e-424f-b3ec-eda6bb57da1a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:47.489111 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c7d3d-f07e-424f-b3ec-eda6bb57da1a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:47.489568 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c7d3d-f07e-424f-b3ec-eda6bb57da1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:47.552789 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 214/426] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:47.562610 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566c2c8-363f-464e-9b0f-da31116dfe7e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:47.565698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c7d3d-f07e-424f-b3ec-eda6bb57da1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:47.567899 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c7d3d-f07e-424f-b3ec-eda6bb57da1a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:47.662606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:47.687150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 213/427] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:47.697906 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c7d3d-f07e-424f-b3ec-eda6bb57da1a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:47.738127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566c2c8-363f-464e-9b0f-da31116dfe7e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:47.743875 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:47.770347 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e99b3-c548-4484-99f0-4361b4b1e0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:47.771038 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e99b3-c548-4484-99f0-4361b4b1e0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:47.784564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e99b3-c548-4484-99f0-4361b4b1e0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:47.784564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e99b3-c548-4484-99f0-4361b4b1e0b9 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:47.784564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e99b3-c548-4484-99f0-4361b4b1e0b9 None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:47.784564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716e99b3-c548-4484-99f0-4361b4b1e0b9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:47.784564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 215/428] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:47 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:47.784564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e99b3-c548-4484-99f0-4361b4b1e0b9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:47.905880 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c7d3d-f07e-424f-b3ec-eda6bb57da1a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:47.932631 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e99b3-c548-4484-99f0-4361b4b1e0b9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:47.944790 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eba725-a172-4ecc-b803-511ddffabdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:47.945509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eba725-a172-4ecc-b803-511ddffabdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:47.945794 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eba725-a172-4ecc-b803-511ddffabdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:47.946065 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eba725-a172-4ecc-b803-511ddffabdd2 None admin] PATH_INFO: `/v3/projects/3d0a846940634bc59ecf00e3124e353c` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:47.947358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eba725-a172-4ecc-b803-511ddffabdd2 None admin] RBAC: Authorizing `identity:get_project(project_id=3d0a846940634bc59ecf00e3124e353c)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:47.948899 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eba725-a172-4ecc-b803-511ddffabdd2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:47.950983 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 214/429] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:47 2022] GET /identity/v3/projects/3d0a846940634bc59ecf00e3124e353c => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:47.951933 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eba725-a172-4ecc-b803-511ddffabdd2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:47.972445 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e630c-0b70-47cd-bfc6-3fe5b7ea60bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:47.973090 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e630c-0b70-47cd-bfc6-3fe5b7ea60bb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:47.973368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e630c-0b70-47cd-bfc6-3fe5b7ea60bb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:47.973745 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e630c-0b70-47cd-bfc6-3fe5b7ea60bb None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:47.975041 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e630c-0b70-47cd-bfc6-3fe5b7ea60bb None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:47.976472 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e630c-0b70-47cd-bfc6-3fe5b7ea60bb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:47.978180 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 216/430] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:47 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:47.978933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e630c-0b70-47cd-bfc6-3fe5b7ea60bb None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:48.017415 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:48.031677 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:48.092357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eba725-a172-4ecc-b803-511ddffabdd2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:48.099409 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e630c-0b70-47cd-bfc6-3fe5b7ea60bb None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:48.135657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f6ae-7b73-414b-b034-c349c0b2825a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:48.136661 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f6ae-7b73-414b-b034-c349c0b2825a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:48.137154 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f6ae-7b73-414b-b034-c349c0b2825a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:48.137530 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f6ae-7b73-414b-b034-c349c0b2825a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:48.140983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c05df7-57c7-4148-8656-c14ceafd4448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:48.141779 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c05df7-57c7-4148-8656-c14ceafd4448 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:48.142287 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c05df7-57c7-4148-8656-c14ceafd4448 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:48.142703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c05df7-57c7-4148-8656-c14ceafd4448 None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:48.145423 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c05df7-57c7-4148-8656-c14ceafd4448 None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:48.147705 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c05df7-57c7-4148-8656-c14ceafd4448 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:48.149841 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07f6ae-7b73-414b-b034-c349c0b2825a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:48.150207 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 217/431] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:47 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:48.151151 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c05df7-57c7-4148-8656-c14ceafd4448 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7f07f6ae-7b73-414b-b034-c349c0b2825a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:48.162675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:48.163589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:48.164793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 215/432] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:48.165447 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f6ae-7b73-414b-b034-c349c0b2825a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:48.266673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07f6ae-7b73-414b-b034-c349c0b2825a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:48.267701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c05df7-57c7-4148-8656-c14ceafd4448 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:48.268949 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:48.280346 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:48.300052 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a821448-c6ae-4d24-9afd-c4ba6e93943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:48.300657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a821448-c6ae-4d24-9afd-c4ba6e93943d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:48.300937 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a821448-c6ae-4d24-9afd-c4ba6e93943d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:48.301187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c98a1c-7e64-40da-9bfb-05375b562d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:48.301292 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a821448-c6ae-4d24-9afd-c4ba6e93943d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:48.301790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c98a1c-7e64-40da-9bfb-05375b562d90 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:48.301913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a821448-c6ae-4d24-9afd-c4ba6e93943d None admin] RBAC: Adding query filter params (group.id=e10f1b6635c1404a89a3bad13758b5c2, role.id=adc491d8d49c47779e572883af3ed47e, scope.project.id=3d0a846940634bc59ecf00e3124e353c) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:48.302072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c98a1c-7e64-40da-9bfb-05375b562d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:48.302253 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a821448-c6ae-4d24-9afd-c4ba6e93943d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:48.302373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c98a1c-7e64-40da-9bfb-05375b562d90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:48.303121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c98a1c-7e64-40da-9bfb-05375b562d90 None admin] RBAC: Adding query filter params (group.id=e10f1b6635c1404a89a3bad13758b5c2, role.id=550a417973df4feda528c3e0787c1619, scope.project.id=3d0a846940634bc59ecf00e3124e353c) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:48.303428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c98a1c-7e64-40da-9bfb-05375b562d90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:48.303673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a821448-c6ae-4d24-9afd-c4ba6e93943d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:48.304880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c98a1c-7e64-40da-9bfb-05375b562d90 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:48.309372 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 216/433] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 07:11:48 2022] GET /identity/v3/role_assignments?group.id=e10f1b6635c1404a89a3bad13758b5c2&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=adc491d8d49c47779e572883af3ed47e => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:48.310747 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f7357-5c9b-492e-a6eb-a349b9be1a4c None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:48.310864 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 218/434] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 07:11:48 2022] GET /identity/v3/role_assignments?group.id=e10f1b6635c1404a89a3bad13758b5c2&scope.project.id=3d0a846940634bc59ecf00e3124e353c&role.id=550a417973df4feda528c3e0787c1619 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:48.310938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f7357-5c9b-492e-a6eb-a349b9be1a4c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:48.311156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f7357-5c9b-492e-a6eb-a349b9be1a4c None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:48.317209 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 217/435] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:48.317209 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50dc02-d37c-45da-bbe4-de14666617fc None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:48.317209 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50dc02-d37c-45da-bbe4-de14666617fc None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:48.317209 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50dc02-d37c-45da-bbe4-de14666617fc None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:48.317209 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 218/436] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:48.319694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aa800-cdf8-4c26-b18a-b5d55b54c08b None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:48.320280 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aa800-cdf8-4c26-b18a-b5d55b54c08b None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:48.320635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aa800-cdf8-4c26-b18a-b5d55b54c08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:48.323263 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c98a1c-7e64-40da-9bfb-05375b562d90 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:48.349334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-de8aa800-cdf8-4c26-b18a-b5d55b54c08b None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:48.350790 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-de8aa800-cdf8-4c26-b18a-b5d55b54c08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:48.452293 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c98a1c-7e64-40da-9bfb-05375b562d90 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:48.460360 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 219/437] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:48.465995 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416c2ab-e6c5-428e-92b0-f7dd0b95fbd8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:48.465995 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416c2ab-e6c5-428e-92b0-f7dd0b95fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:48.465995 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416c2ab-e6c5-428e-92b0-f7dd0b95fbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:48.486232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b416c2ab-e6c5-428e-92b0-f7dd0b95fbd8 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:48.487969 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b416c2ab-e6c5-428e-92b0-f7dd0b95fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:48.502092 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc826cff-a70b-46b7-af40-866a77e791a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:48.503322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc826cff-a70b-46b7-af40-866a77e791a2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:48.503604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc826cff-a70b-46b7-af40-866a77e791a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:48.503948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc826cff-a70b-46b7-af40-866a77e791a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:48.504618 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc826cff-a70b-46b7-af40-866a77e791a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:48.504916 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc826cff-a70b-46b7-af40-866a77e791a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:48.507310 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc826cff-a70b-46b7-af40-866a77e791a2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:48.518010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 219/438] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:11:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:48.525674 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc826cff-a70b-46b7-af40-866a77e791a2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:48.583015 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:48.587904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 220/439] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:48.655215 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc826cff-a70b-46b7-af40-866a77e791a2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:48.693766 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9da383-f268-4f29-ade0-cf65fa64de03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:48.694690 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da383-f268-4f29-ade0-cf65fa64de03 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:48.695120 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da383-f268-4f29-ade0-cf65fa64de03 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:48.695392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da383-f268-4f29-ade0-cf65fa64de03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:48.773098 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9da383-f268-4f29-ade0-cf65fa64de03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:48.774574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9da383-f268-4f29-ade0-cf65fa64de03 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:48.789914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416c2ab-e6c5-428e-92b0-f7dd0b95fbd8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:48.820124 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:48.825661 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:48.896930 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 220/440] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:48.897788 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9da383-f268-4f29-ade0-cf65fa64de03 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:48.931208 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416c2ab-e6c5-428e-92b0-f7dd0b95fbd8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:48.976643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392fd2c-c9a6-4cfa-97d6-eba1c69186ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:48.977270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392fd2c-c9a6-4cfa-97d6-eba1c69186ab None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:48.977543 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392fd2c-c9a6-4cfa-97d6-eba1c69186ab None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:48.977809 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392fd2c-c9a6-4cfa-97d6-eba1c69186ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:48.989964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6392fd2c-c9a6-4cfa-97d6-eba1c69186ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6392fd2c-c9a6-4cfa-97d6-eba1c69186ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:48.993155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:48.994008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 221/441] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:48.995674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392fd2c-c9a6-4cfa-97d6-eba1c69186ab None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:49.013887 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9da383-f268-4f29-ade0-cf65fa64de03 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:49.048341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108c305-834b-4bbd-8102-ff4f4315498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:49.048900 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108c305-834b-4bbd-8102-ff4f4315498d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:49.049181 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108c305-834b-4bbd-8102-ff4f4315498d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:49.049564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108c305-834b-4bbd-8102-ff4f4315498d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:49.056348 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:49.059830 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108c305-834b-4bbd-8102-ff4f4315498d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2108c305-834b-4bbd-8102-ff4f4315498d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:49.064559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:49.071035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 221/442] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:11:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:49.072009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108c305-834b-4bbd-8102-ff4f4315498d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:49.086724 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:49.099048 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392fd2c-c9a6-4cfa-97d6-eba1c69186ab None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:49.132646 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29834d0c-75bd-439d-a15b-44a3d6662eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:49.133259 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29834d0c-75bd-439d-a15b-44a3d6662eb1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:49.133534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29834d0c-75bd-439d-a15b-44a3d6662eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:49.133800 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29834d0c-75bd-439d-a15b-44a3d6662eb1 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:49.134922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29834d0c-75bd-439d-a15b-44a3d6662eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:49.136516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29834d0c-75bd-439d-a15b-44a3d6662eb1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:49.138119 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 222/443] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:48 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:49.138876 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29834d0c-75bd-439d-a15b-44a3d6662eb1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:49.169137 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108c305-834b-4bbd-8102-ff4f4315498d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:49.202864 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a82a2b-d424-4f72-b167-dbe19dd04d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:49.203463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a82a2b-d424-4f72-b167-dbe19dd04d6a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:49.203739 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a82a2b-d424-4f72-b167-dbe19dd04d6a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:49.204006 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a82a2b-d424-4f72-b167-dbe19dd04d6a None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:49.204657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a82a2b-d424-4f72-b167-dbe19dd04d6a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:49.204955 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a82a2b-d424-4f72-b167-dbe19dd04d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:49.206967 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a82a2b-d424-4f72-b167-dbe19dd04d6a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:49.214873 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 222/444] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:49.215846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a82a2b-d424-4f72-b167-dbe19dd04d6a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:49.240799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29834d0c-75bd-439d-a15b-44a3d6662eb1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:49.273486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:49.275554 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1b191-b3fe-470f-8815-d04724e6dab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:49.276151 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1b191-b3fe-470f-8815-d04724e6dab3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:49.276428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1b191-b3fe-470f-8815-d04724e6dab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:49.276695 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1b191-b3fe-470f-8815-d04724e6dab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:49.277345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1b191-b3fe-470f-8815-d04724e6dab3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:49.277643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1b191-b3fe-470f-8815-d04724e6dab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:49.279030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1b191-b3fe-470f-8815-d04724e6dab3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:49.287297 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 223/445] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:49.287993 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1b191-b3fe-470f-8815-d04724e6dab3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:49.307205 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:49.314468 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a82a2b-d424-4f72-b167-dbe19dd04d6a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:49.351184 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac206a9-7448-4eff-8e0d-3ba979440d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:49.351807 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac206a9-7448-4eff-8e0d-3ba979440d4a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:49.352083 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac206a9-7448-4eff-8e0d-3ba979440d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:49.352350 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac206a9-7448-4eff-8e0d-3ba979440d4a None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:49.353448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac206a9-7448-4eff-8e0d-3ba979440d4a None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:49.354897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac206a9-7448-4eff-8e0d-3ba979440d4a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:49.356442 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 223/446] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:49 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:49.357191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac206a9-7448-4eff-8e0d-3ba979440d4a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:49.391736 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1b191-b3fe-470f-8815-d04724e6dab3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:49.425541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217856-696c-4edd-bba0-940658511a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:49.426172 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217856-696c-4edd-bba0-940658511a6c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:49.426455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217856-696c-4edd-bba0-940658511a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:49.426719 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4217856-696c-4edd-bba0-940658511a6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:49.460003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac206a9-7448-4eff-8e0d-3ba979440d4a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:49.485849 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:49.493955 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d148-3e28-4189-8c94-fd1910bb89e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:49.498972 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d148-3e28-4189-8c94-fd1910bb89e8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:49.499093 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4217856-696c-4edd-bba0-940658511a6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:49.499194 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d148-3e28-4189-8c94-fd1910bb89e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:49.499194 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64d148-3e28-4189-8c94-fd1910bb89e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:49.499347 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4217856-696c-4edd-bba0-940658511a6c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:49.514613 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:49.562480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64d148-3e28-4189-8c94-fd1910bb89e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:49.563852 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64d148-3e28-4189-8c94-fd1910bb89e8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:49.596610 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 224/447] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:49.597459 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217856-696c-4edd-bba0-940658511a6c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:49.672581 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 224/448] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:49.673417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d148-3e28-4189-8c94-fd1910bb89e8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:49.697443 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4217856-696c-4edd-bba0-940658511a6c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:49.703240 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:49.714656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:49.731422 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d33fa4-ca3a-497b-be9d-0594742f0758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:49.732015 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33fa4-ca3a-497b-be9d-0594742f0758 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:49.732293 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33fa4-ca3a-497b-be9d-0594742f0758 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:49.732562 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33fa4-ca3a-497b-be9d-0594742f0758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:49.733276 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d33fa4-ca3a-497b-be9d-0594742f0758 None admin] RBAC: Adding query filter params (group.id=e10f1b6635c1404a89a3bad13758b5c2, role.id=550a417973df4feda528c3e0787c1619, scope.project.id=bc5ad8f68599461690aa33f7d63a0536) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:49.733657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d33fa4-ca3a-497b-be9d-0594742f0758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:49.735052 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d33fa4-ca3a-497b-be9d-0594742f0758 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:49.741410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 225/449] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 07:11:49 2022] GET /identity/v3/role_assignments?group.id=e10f1b6635c1404a89a3bad13758b5c2&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=550a417973df4feda528c3e0787c1619 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:49.742252 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d33fa4-ca3a-497b-be9d-0594742f0758 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:49.781057 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64d148-3e28-4189-8c94-fd1910bb89e8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:49.819224 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35622cfc-890a-4dd1-a8ae-403ee9ab50d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:49.819784 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35622cfc-890a-4dd1-a8ae-403ee9ab50d0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:49.820062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35622cfc-890a-4dd1-a8ae-403ee9ab50d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:49.820331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35622cfc-890a-4dd1-a8ae-403ee9ab50d0 None admin] PATH_INFO: `/v3/projects/bc5ad8f68599461690aa33f7d63a0536` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:49.821497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35622cfc-890a-4dd1-a8ae-403ee9ab50d0 None admin] RBAC: Authorizing `identity:get_project(project_id=bc5ad8f68599461690aa33f7d63a0536)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:49.822996 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35622cfc-890a-4dd1-a8ae-403ee9ab50d0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:49.824682 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 225/450] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:49 2022] GET /identity/v3/projects/bc5ad8f68599461690aa33f7d63a0536 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:49.830310 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35622cfc-890a-4dd1-a8ae-403ee9ab50d0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:49.867124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d33fa4-ca3a-497b-be9d-0594742f0758 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:49.912782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa3152-2c22-4856-8c9f-b6c9662adda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:49.913419 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa3152-2c22-4856-8c9f-b6c9662adda2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:49.913720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa3152-2c22-4856-8c9f-b6c9662adda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:49.913988 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa3152-2c22-4856-8c9f-b6c9662adda2 None admin] PATH_INFO: `/v3/projects/446e3fa3333244a786f2fbb60ab9e0a2` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:49.915164 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa3152-2c22-4856-8c9f-b6c9662adda2 None admin] RBAC: Authorizing `identity:get_project(project_id=446e3fa3333244a786f2fbb60ab9e0a2)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:49.916583 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa3152-2c22-4856-8c9f-b6c9662adda2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:49.919924 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 226/451] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:11:49 2022] GET /identity/v3/projects/446e3fa3333244a786f2fbb60ab9e0a2 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:49.925936 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa3152-2c22-4856-8c9f-b6c9662adda2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:49.951547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:49.958790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35622cfc-890a-4dd1-a8ae-403ee9ab50d0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:49.982249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:50.001020 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2218c-2a44-4c54-aa09-bc8397a9a825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:50.001656 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2218c-2a44-4c54-aa09-bc8397a9a825 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:50.001934 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2218c-2a44-4c54-aa09-bc8397a9a825 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:50.002271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2218c-2a44-4c54-aa09-bc8397a9a825 None admin] PATH_INFO: `/v3/groups/e10f1b6635c1404a89a3bad13758b5c2` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:50.003581 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2218c-2a44-4c54-aa09-bc8397a9a825 None admin] RBAC: Authorizing `identity:get_group(group_id=e10f1b6635c1404a89a3bad13758b5c2)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:50.004964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2218c-2a44-4c54-aa09-bc8397a9a825 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:50.006878 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 226/452] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:49 2022] GET /identity/v3/groups/e10f1b6635c1404a89a3bad13758b5c2 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:50.013900 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2218c-2a44-4c54-aa09-bc8397a9a825 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:50.047768 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa3152-2c22-4856-8c9f-b6c9662adda2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:50.087126 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb446ca7-2325-4ae3-9016-9e42971bb63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:50.088038 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb446ca7-2325-4ae3-9016-9e42971bb63c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:50.088510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb446ca7-2325-4ae3-9016-9e42971bb63c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:50.088948 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb446ca7-2325-4ae3-9016-9e42971bb63c None admin] PATH_INFO: `/v3/groups/4013098f76734858b365cb2af26d5af8` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:50.090082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb446ca7-2325-4ae3-9016-9e42971bb63c None admin] RBAC: Authorizing `identity:get_group(group_id=4013098f76734858b365cb2af26d5af8)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:50.091901 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb446ca7-2325-4ae3-9016-9e42971bb63c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:50.093397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 227/453] 10.222.0.16 () {56 vars in 1180 bytes} [Tue Aug 23 07:11:49 2022] GET /identity/v3/groups/4013098f76734858b365cb2af26d5af8 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:50.099955 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb446ca7-2325-4ae3-9016-9e42971bb63c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:50.130506 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2218c-2a44-4c54-aa09-bc8397a9a825 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:50.163868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd6c66-82ad-46d5-815f-7711c6433b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:50.164464 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd6c66-82ad-46d5-815f-7711c6433b53 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:50.164747 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd6c66-82ad-46d5-815f-7711c6433b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:50.165019 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd6c66-82ad-46d5-815f-7711c6433b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:50.165744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd6c66-82ad-46d5-815f-7711c6433b53 None admin] RBAC: Adding query filter params (group.id=e10f1b6635c1404a89a3bad13758b5c2, role.id=adc491d8d49c47779e572883af3ed47e, scope.project.id=bc5ad8f68599461690aa33f7d63a0536) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:50.166047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd6c66-82ad-46d5-815f-7711c6433b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:50.167503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd6c66-82ad-46d5-815f-7711c6433b53 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:50.173079 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 227/454] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 07:11:50 2022] GET /identity/v3/role_assignments?group.id=e10f1b6635c1404a89a3bad13758b5c2&scope.project.id=bc5ad8f68599461690aa33f7d63a0536&role.id=adc491d8d49c47779e572883af3ed47e => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:50.200488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb446ca7-2325-4ae3-9016-9e42971bb63c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:50.220017 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:50.238331 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589d015-486e-4566-8519-ef4bd91687fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:50.238930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589d015-486e-4566-8519-ef4bd91687fd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:50.239209 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589d015-486e-4566-8519-ef4bd91687fd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:50.239480 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589d015-486e-4566-8519-ef4bd91687fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:50.240264 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589d015-486e-4566-8519-ef4bd91687fd None admin] RBAC: Adding query filter params (group.id=4013098f76734858b365cb2af26d5af8, role.id=afe88bc03d30494b89892587177c79de, scope.project.id=446e3fa3333244a786f2fbb60ab9e0a2) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:50.240572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589d015-486e-4566-8519-ef4bd91687fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:50.242047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589d015-486e-4566-8519-ef4bd91687fd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:50.249068 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 228/455] 10.222.0.16 () {56 vars in 1376 bytes} [Tue Aug 23 07:11:50 2022] GET /identity/v3/role_assignments?group.id=4013098f76734858b365cb2af26d5af8&scope.project.id=446e3fa3333244a786f2fbb60ab9e0a2&role.id=afe88bc03d30494b89892587177c79de => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:52.796673 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ee183-8c7e-48d4-9a87-94d0a283d5c8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:52.797176 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ee183-8c7e-48d4-9a87-94d0a283d5c8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:52.797251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ee183-8c7e-48d4-9a87-94d0a283d5c8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:52.798873 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 228/456] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:52.804645 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6d50-344d-4540-8e6a-10a55b71f349 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:52.805449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6d50-344d-4540-8e6a-10a55b71f349 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:52.805943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe6d50-344d-4540-8e6a-10a55b71f349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:52.832641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e0fe6d50-344d-4540-8e6a-10a55b71f349 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:52.834197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e0fe6d50-344d-4540-8e6a-10a55b71f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:52.900480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0ebcd-bc4e-4142-967a-dc1bd404ea5d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:52.900782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0ebcd-bc4e-4142-967a-dc1bd404ea5d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:52.907699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0ebcd-bc4e-4142-967a-dc1bd404ea5d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:52.907699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 229/457] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:52.907699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fbedc-7845-4ea0-9d80-9ad31d541d1d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:52.907915 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fbedc-7845-4ea0-9d80-9ad31d541d1d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:52.908171 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fbedc-7845-4ea0-9d80-9ad31d541d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:52.920719 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 229/458] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:52.947351 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9e2fbedc-7845-4ea0-9d80-9ad31d541d1d None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:52.948586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9e2fbedc-7845-4ea0-9d80-9ad31d541d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:52.987481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:53.020546 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66914-9fd7-47b0-a43c-0b319353c3a2 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:53.020836 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66914-9fd7-47b0-a43c-0b319353c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:53.021115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c66914-9fd7-47b0-a43c-0b319353c3a2 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:53.026128 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 230/459] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:11:53.032848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365eab8-daf4-4888-8e8e-aa48299bddca None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:53.033136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365eab8-daf4-4888-8e8e-aa48299bddca None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:53.033455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365eab8-daf4-4888-8e8e-aa48299bddca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:53.045654 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 230/460] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:53.073466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2365eab8-daf4-4888-8e8e-aa48299bddca None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:53.074676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2365eab8-daf4-4888-8e8e-aa48299bddca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:53.183046 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 231/461] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:53.253510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fbedc-7845-4ea0-9d80-9ad31d541d1d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:53.318798 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365eab8-daf4-4888-8e8e-aa48299bddca None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:53.372368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fbedc-7845-4ea0-9d80-9ad31d541d1d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:53.417287 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f28b8-3f57-45ca-a186-2d7e6f490886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:53.417925 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f28b8-3f57-45ca-a186-2d7e6f490886 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:53.418231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f28b8-3f57-45ca-a186-2d7e6f490886 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:53.421550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f28b8-3f57-45ca-a186-2d7e6f490886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:53.429208 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:53.432061 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f28b8-3f57-45ca-a186-2d7e6f490886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:53.433631 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f28b8-3f57-45ca-a186-2d7e6f490886 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-df6f28b8-3f57-45ca-a186-2d7e6f490886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:11:53.450839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:53.451765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:11:53.452610 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:11:53.452610 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:53.452610 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:53.458474 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 231/462] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:53.459941 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f28b8-3f57-45ca-a186-2d7e6f490886 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:53.478498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:53.566957 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365eab8-daf4-4888-8e8e-aa48299bddca None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:53.574278 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f28b8-3f57-45ca-a186-2d7e6f490886 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:53.619848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f10f30-4c15-438d-874a-bd7ec33abf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:53.620556 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f10f30-4c15-438d-874a-bd7ec33abf40 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:53.621189 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f10f30-4c15-438d-874a-bd7ec33abf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:53.621479 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f10f30-4c15-438d-874a-bd7ec33abf40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:53.628756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6462c-b5c7-49a6-82e5-23d0ef6d040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:53.630015 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6462c-b5c7-49a6-82e5-23d0ef6d040a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:53.630464 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6462c-b5c7-49a6-82e5-23d0ef6d040a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:53.630877 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6462c-b5c7-49a6-82e5-23d0ef6d040a None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:53.632084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6462c-b5c7-49a6-82e5-23d0ef6d040a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:53.632825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6462c-b5c7-49a6-82e5-23d0ef6d040a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:53.633346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f10f30-4c15-438d-874a-bd7ec33abf40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:53.634640 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6462c-b5c7-49a6-82e5-23d0ef6d040a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:53.634894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f10f30-4c15-438d-874a-bd7ec33abf40 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-23f10f30-4c15-438d-874a-bd7ec33abf40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:11:53.652889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:53.654020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:11:53.655045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:11:53.655045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:53.655045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:53.658183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 232/463] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:53.660268 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f10f30-4c15-438d-874a-bd7ec33abf40 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:53.663450 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 232/464] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:11:53.665262 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6462c-b5c7-49a6-82e5-23d0ef6d040a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:53.755523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:53.790605 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:53.794667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6462c-b5c7-49a6-82e5-23d0ef6d040a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:53.797872 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f10f30-4c15-438d-874a-bd7ec33abf40 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:53.829875 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65689d-d37b-4f3b-968e-cf34959b0c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:53.831269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65689d-d37b-4f3b-968e-cf34959b0c3d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:53.831752 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65689d-d37b-4f3b-968e-cf34959b0c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:53.832027 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65689d-d37b-4f3b-968e-cf34959b0c3d None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:53.832682 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65689d-d37b-4f3b-968e-cf34959b0c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:53.833010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65689d-d37b-4f3b-968e-cf34959b0c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:53.834153 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab27033-a054-4237-8bca-89feae2c66e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:53.834530 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65689d-d37b-4f3b-968e-cf34959b0c3d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:53.834777 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27033-a054-4237-8bca-89feae2c66e9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:53.835056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27033-a054-4237-8bca-89feae2c66e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:53.835327 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab27033-a054-4237-8bca-89feae2c66e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:53.846670 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab27033-a054-4237-8bca-89feae2c66e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:53.847643 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 233/465] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:53.848285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65689d-d37b-4f3b-968e-cf34959b0c3d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:53.851422 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab27033-a054-4237-8bca-89feae2c66e9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-0ab27033-a054-4237-8bca-89feae2c66e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:11:53.871838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:53.872758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:11:53.873583 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:11:53.873583 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:53.873583 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:53.873743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 233/466] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:53.874977 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5c440-8ff0-45d0-8d91-c359fcbda695 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:53.875259 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5c440-8ff0-45d0-8d91-c359fcbda695 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:53.875529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5c440-8ff0-45d0-8d91-c359fcbda695 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:53.876908 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 234/467] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:53.877550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5c440-8ff0-45d0-8d91-c359fcbda695 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:53.961092 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65689d-d37b-4f3b-968e-cf34959b0c3d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:53.990799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5c440-8ff0-45d0-8d91-c359fcbda695 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:53.993058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:53.999129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e56f72-ae8c-4298-bb29-b95a9df5dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:53.999733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e56f72-ae8c-4298-bb29-b95a9df5dd08 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:54.000010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e56f72-ae8c-4298-bb29-b95a9df5dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:54.000282 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e56f72-ae8c-4298-bb29-b95a9df5dd08 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:54.000924 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e56f72-ae8c-4298-bb29-b95a9df5dd08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:54.002479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e56f72-ae8c-4298-bb29-b95a9df5dd08 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:54.025345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d29f3f-eeff-4c60-9b64-c27ea36421cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:54.025874 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29f3f-eeff-4c60-9b64-c27ea36421cd None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:54.026180 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29f3f-eeff-4c60-9b64-c27ea36421cd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:54.026453 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d29f3f-eeff-4c60-9b64-c27ea36421cd None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:54.027092 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d29f3f-eeff-4c60-9b64-c27ea36421cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:54.028500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d29f3f-eeff-4c60-9b64-c27ea36421cd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:54.089304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 234/468] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:11:53 2022] POST /identity/v3/users => generated 246 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:54.090127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e56f72-ae8c-4298-bb29-b95a9df5dd08 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:54.112022 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 235/469] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:11:53 2022] POST /identity/v3/users => generated 248 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:54.112022 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c17f3-2a6b-4be5-a3de-c3d7c04ff13e None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:54.112022 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c17f3-2a6b-4be5-a3de-c3d7c04ff13e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:54.112022 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c17f3-2a6b-4be5-a3de-c3d7c04ff13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:54.126606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:54.139533 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-426c17f3-2a6b-4be5-a3de-c3d7c04ff13e None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:54.140802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-426c17f3-2a6b-4be5-a3de-c3d7c04ff13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:54.226917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e56f72-ae8c-4298-bb29-b95a9df5dd08 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:54.229074 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 236/470] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:54.231087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775612e-5d77-4747-905e-4162daae11b8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:54.231087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775612e-5d77-4747-905e-4162daae11b8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:54.231087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775612e-5d77-4747-905e-4162daae11b8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:54.237130 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 237/471] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:54.239451 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819bcf-b340-4d8d-86d8-bfe00de1a518 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:54.239451 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819bcf-b340-4d8d-86d8-bfe00de1a518 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:54.239730 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819bcf-b340-4d8d-86d8-bfe00de1a518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:54.260103 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-71819bcf-b340-4d8d-86d8-bfe00de1a518 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:54.261546 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-71819bcf-b340-4d8d-86d8-bfe00de1a518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:54.269378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625c79f-59bd-4345-81bc-d5df34c46103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:54.270270 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625c79f-59bd-4345-81bc-d5df34c46103 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:54.270717 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625c79f-59bd-4345-81bc-d5df34c46103 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:54.271125 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625c79f-59bd-4345-81bc-d5df34c46103 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:54.271924 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625c79f-59bd-4345-81bc-d5df34c46103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:54.272366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625c79f-59bd-4345-81bc-d5df34c46103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:54.273960 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625c79f-59bd-4345-81bc-d5df34c46103 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:54.288442 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 235/472] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:54.293973 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625c79f-59bd-4345-81bc-d5df34c46103 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:54.351416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:54.352714 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 238/473] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:54.409551 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625c79f-59bd-4345-81bc-d5df34c46103 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:54.444883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb24aa-b57f-4123-a2ce-c4a2710ec000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:54.445492 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb24aa-b57f-4123-a2ce-c4a2710ec000 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:54.445776 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb24aa-b57f-4123-a2ce-c4a2710ec000 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:54.446050 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb24aa-b57f-4123-a2ce-c4a2710ec000 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:54.446721 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb24aa-b57f-4123-a2ce-c4a2710ec000 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:54.448206 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeb24aa-b57f-4123-a2ce-c4a2710ec000 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:54.545764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71819bcf-b340-4d8d-86d8-bfe00de1a518 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:54.547330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 236/474] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:11:54 2022] POST /identity/v3/users => generated 248 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:11:54.653110 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:54.681040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb24aa-b57f-4123-a2ce-c4a2710ec000 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:54.730978 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71819bcf-b340-4d8d-86d8-bfe00de1a518 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:54.784732 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8fc35-5d4b-45ac-a66b-bca7221f51b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:54.785706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8fc35-5d4b-45ac-a66b-bca7221f51b3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:54.786319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8fc35-5d4b-45ac-a66b-bca7221f51b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:54.786815 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8fc35-5d4b-45ac-a66b-bca7221f51b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:54.803863 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8fc35-5d4b-45ac-a66b-bca7221f51b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:54.805687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8fc35-5d4b-45ac-a66b-bca7221f51b3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:54.821877 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeb24aa-b57f-4123-a2ce-c4a2710ec000 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:54.823458 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3be8fc35-5d4b-45ac-a66b-bca7221f51b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:11:54.825295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:54.826235 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:11:54.827069 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:11:54.827069 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:54.827069 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:54.829890 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 239/475] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:54.835809 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8fc35-5d4b-45ac-a66b-bca7221f51b3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:54.869190 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad617c44-d9b1-438a-8cc1-afd84e2861f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:54.869887 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617c44-d9b1-438a-8cc1-afd84e2861f4 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:54.870072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617c44-d9b1-438a-8cc1-afd84e2861f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:54.870369 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad617c44-d9b1-438a-8cc1-afd84e2861f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:54.871176 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad617c44-d9b1-438a-8cc1-afd84e2861f4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:54.874075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad617c44-d9b1-438a-8cc1-afd84e2861f4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:54.918588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.sql.core [None req-ad617c44-d9b1-438a-8cc1-afd84e2861f4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 07:11:54.918588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 07:11:54.918588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [parameters: {'id': '2205a7fe13d849da96cf1764c809c2ce', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 07:11:54.918588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81573) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ad617c44-d9b1-438a-8cc1-afd84e2861f4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Aug 23 07:11:54.942406 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return ref.to_dict() Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:11:54.943335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application yield resource Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise self.value Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application session.commit() Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 07:11:54.944222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.flush() Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application compat.raise_( Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 07:11:54.945993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:11:54.947219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:11:54.948258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [parameters: {'id': '2205a7fe13d849da96cf1764c809c2ce', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:54.950593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 07:11:54.952832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:54.958870 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 237/476] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 23 07:11:54 2022] POST /identity/v3/roles => generated 144 bytes in 264 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:54.958870 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad617c44-d9b1-438a-8cc1-afd84e2861f4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:54.994505 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8fc35-5d4b-45ac-a66b-bca7221f51b3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:55.013957 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:55.041650 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746fa2-ae85-4bb3-a1f6-7bf2bacc4d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:55.042642 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746fa2-ae85-4bb3-a1f6-7bf2bacc4d93 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:55.042942 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746fa2-ae85-4bb3-a1f6-7bf2bacc4d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:55.043198 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2746fa2-ae85-4bb3-a1f6-7bf2bacc4d93 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:55.043849 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2746fa2-ae85-4bb3-a1f6-7bf2bacc4d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:55.044149 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2746fa2-ae85-4bb3-a1f6-7bf2bacc4d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:55.046675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2746fa2-ae85-4bb3-a1f6-7bf2bacc4d93 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:55.065261 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 240/477] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:55.079067 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746fa2-ae85-4bb3-a1f6-7bf2bacc4d93 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:55.100410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad617c44-d9b1-438a-8cc1-afd84e2861f4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:55.166975 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be56b39-4900-47c2-b366-0cb17331688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:55.167871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be56b39-4900-47c2-b366-0cb17331688b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:55.168287 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be56b39-4900-47c2-b366-0cb17331688b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:55.168691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be56b39-4900-47c2-b366-0cb17331688b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:55.192087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be56b39-4900-47c2-b366-0cb17331688b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3be56b39-4900-47c2-b366-0cb17331688b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:55.198696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:55.199559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:55.200345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 238/478] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:11:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:55.205426 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be56b39-4900-47c2-b366-0cb17331688b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:55.247524 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2746fa2-ae85-4bb3-a1f6-7bf2bacc4d93 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:55.269482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:55.289112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23e7df-04fa-45db-b414-a96e7d56c5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:55.290116 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23e7df-04fa-45db-b414-a96e7d56c5d1 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:55.294591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23e7df-04fa-45db-b414-a96e7d56c5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:55.295068 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23e7df-04fa-45db-b414-a96e7d56c5d1 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:55.295904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23e7df-04fa-45db-b414-a96e7d56c5d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:55.297549 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23e7df-04fa-45db-b414-a96e7d56c5d1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:55.372973 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be56b39-4900-47c2-b366-0cb17331688b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:55.409242 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535ed50-4ed6-4e58-83ee-48d2650dedd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:55.409844 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535ed50-4ed6-4e58-83ee-48d2650dedd2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:55.410143 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535ed50-4ed6-4e58-83ee-48d2650dedd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:55.410424 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535ed50-4ed6-4e58-83ee-48d2650dedd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:55.411168 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535ed50-4ed6-4e58-83ee-48d2650dedd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:55.411472 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535ed50-4ed6-4e58-83ee-48d2650dedd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:55.412796 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 241/479] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:11:55 2022] POST /identity/v3/users => generated 249 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:11:55.413155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535ed50-4ed6-4e58-83ee-48d2650dedd2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:55.423073 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 239/480] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:11:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:56.559897 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc936-765d-431b-b785-d3db1be306cd None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:56.560402 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc936-765d-431b-b785-d3db1be306cd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:56.560476 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc936-765d-431b-b785-d3db1be306cd None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:56.562053 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 242/481] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:56.586011 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bfe42-5b52-4035-965d-7801ece8baba None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:56.586471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bfe42-5b52-4035-965d-7801ece8baba None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:56.586637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bfe42-5b52-4035-965d-7801ece8baba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:56.609776 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-fa4bfe42-5b52-4035-965d-7801ece8baba None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:56.611014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fa4bfe42-5b52-4035-965d-7801ece8baba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:56.648410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9f9ab-ba16-46d0-9ce6-6a259e060560 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:56.649031 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9f9ab-ba16-46d0-9ce6-6a259e060560 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:56.649498 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9f9ab-ba16-46d0-9ce6-6a259e060560 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:56.651350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 243/482] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:56.657107 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed01a3-f0e7-400c-9e49-c5d93e7dd618 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:56.657657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed01a3-f0e7-400c-9e49-c5d93e7dd618 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:56.658182 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed01a3-f0e7-400c-9e49-c5d93e7dd618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:56.697826 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 240/483] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:56.699124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-55ed01a3-f0e7-400c-9e49-c5d93e7dd618 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:56.700316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-55ed01a3-f0e7-400c-9e49-c5d93e7dd618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:56.739195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:56.799654 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 244/484] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:56.974047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bfe42-5b52-4035-965d-7801ece8baba None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:56.982935 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608531a-b16d-4d74-87ca-8df0a6059b3e None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:56.983505 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608531a-b16d-4d74-87ca-8df0a6059b3e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:56.984014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608531a-b16d-4d74-87ca-8df0a6059b3e None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:56.985605 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 245/485] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:56.991474 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e5697-e16a-4f08-ac00-d472199de824 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:56.991756 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e5697-e16a-4f08-ac00-d472199de824 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:56.992026 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e5697-e16a-4f08-ac00-d472199de824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:57.002798 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:57.010126 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6a2e5697-e16a-4f08-ac00-d472199de824 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:57.011384 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6a2e5697-e16a-4f08-ac00-d472199de824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:57.106382 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 246/486] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:11:57.144840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bfe42-5b52-4035-965d-7801ece8baba None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:57.173464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e5697-e16a-4f08-ac00-d472199de824 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:57.197506 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b99d34-837f-49bb-b1c0-c842b055bd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:57.198165 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b99d34-837f-49bb-b1c0-c842b055bd2c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:57.198444 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b99d34-837f-49bb-b1c0-c842b055bd2c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:57.198717 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b99d34-837f-49bb-b1c0-c842b055bd2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:57.214497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b99d34-837f-49bb-b1c0-c842b055bd2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-81b99d34-837f-49bb-b1c0-c842b055bd2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:57.219848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:57.220817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:57.221976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 241/487] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:57.230502 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b99d34-837f-49bb-b1c0-c842b055bd2c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:57.270285 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:57.279125 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e5697-e16a-4f08-ac00-d472199de824 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:57.315405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b93af1-03ad-4ec8-9c60-6e6b698c251a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:57.316143 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93af1-03ad-4ec8-9c60-6e6b698c251a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:57.316498 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93af1-03ad-4ec8-9c60-6e6b698c251a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:57.317065 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b93af1-03ad-4ec8-9c60-6e6b698c251a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:57.328731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b93af1-03ad-4ec8-9c60-6e6b698c251a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-c6b93af1-03ad-4ec8-9c60-6e6b698c251a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:57.333572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:57.335532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:11:57.337470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:57.346153 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 247/488] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:11:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:11:57.346153 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b93af1-03ad-4ec8-9c60-6e6b698c251a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:57.364753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:57.403054 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b99d34-837f-49bb-b1c0-c842b055bd2c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:57.451442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b93af1-03ad-4ec8-9c60-6e6b698c251a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:57.462318 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a190e3-2040-4737-aa03-2c0d3dacff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:57.462929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a190e3-2040-4737-aa03-2c0d3dacff55 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:57.463211 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a190e3-2040-4737-aa03-2c0d3dacff55 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:57.463481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a190e3-2040-4737-aa03-2c0d3dacff55 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:57.464153 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a190e3-2040-4737-aa03-2c0d3dacff55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:57.464453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a190e3-2040-4737-aa03-2c0d3dacff55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:57.465833 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a190e3-2040-4737-aa03-2c0d3dacff55 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:57.475061 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 242/489] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:57.475938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a190e3-2040-4737-aa03-2c0d3dacff55 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:57.498166 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f9ef-67a0-498c-bb14-5e58531e22d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:57.499035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f9ef-67a0-498c-bb14-5e58531e22d7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:57.499544 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f9ef-67a0-498c-bb14-5e58531e22d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:57.500018 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f9ef-67a0-498c-bb14-5e58531e22d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:57.500994 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5f9ef-67a0-498c-bb14-5e58531e22d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:57.501613 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5f9ef-67a0-498c-bb14-5e58531e22d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:57.503939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5f9ef-67a0-498c-bb14-5e58531e22d7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:57.513250 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 248/490] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:57.514289 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f9ef-67a0-498c-bb14-5e58531e22d7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:57.530769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:57.586278 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a190e3-2040-4737-aa03-2c0d3dacff55 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:57.626694 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca614-844d-4532-a2ef-5f5790958a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:57.627860 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca614-844d-4532-a2ef-5f5790958a5e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:57.628139 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca614-844d-4532-a2ef-5f5790958a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:57.628506 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ca614-844d-4532-a2ef-5f5790958a5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:57.629990 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f9ef-67a0-498c-bb14-5e58531e22d7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:57.636624 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:57.641091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ca614-844d-4532-a2ef-5f5790958a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-466ca614-844d-4532-a2ef-5f5790958a5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:57.646743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:57.647634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:57.648412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 243/491] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:11:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:57.649080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca614-844d-4532-a2ef-5f5790958a5e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:57.679637 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92c05-4919-49fd-b6c4-94c805e8ad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:57.680262 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92c05-4919-49fd-b6c4-94c805e8ad51 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:57.680541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92c05-4919-49fd-b6c4-94c805e8ad51 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:57.680810 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92c05-4919-49fd-b6c4-94c805e8ad51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:57.694296 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e92c05-4919-49fd-b6c4-94c805e8ad51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:57.696168 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e92c05-4919-49fd-b6c4-94c805e8ad51 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-03e92c05-4919-49fd-b6c4-94c805e8ad51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:11:57.712698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:57.713659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:11:57.714532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:11:57.714532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:57.714532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:57.722141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 249/492] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:57.723349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92c05-4919-49fd-b6c4-94c805e8ad51 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:57.772769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ca614-844d-4532-a2ef-5f5790958a5e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:57.793386 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:57.811349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466491e5-18cf-4f28-998d-3d2e3934a8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:57.812339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466491e5-18cf-4f28-998d-3d2e3934a8c0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:57.812771 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466491e5-18cf-4f28-998d-3d2e3934a8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:57.813048 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466491e5-18cf-4f28-998d-3d2e3934a8c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:57.824532 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466491e5-18cf-4f28-998d-3d2e3934a8c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:57.826023 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466491e5-18cf-4f28-998d-3d2e3934a8c0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:57.838299 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e92c05-4919-49fd-b6c4-94c805e8ad51 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-466491e5-18cf-4f28-998d-3d2e3934a8c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:11:57.840689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:57.841814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:11:57.842662 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:11:57.842662 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:57.842662 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:57.842662 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 244/493] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:57.842870 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466491e5-18cf-4f28-998d-3d2e3934a8c0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:57.877323 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f99ba-b0fe-46e5-a337-2119cdd3679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:57.877915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f99ba-b0fe-46e5-a337-2119cdd3679e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:57.878221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f99ba-b0fe-46e5-a337-2119cdd3679e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:57.878489 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f99ba-b0fe-46e5-a337-2119cdd3679e None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:57.879149 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f99ba-b0fe-46e5-a337-2119cdd3679e None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:57.879446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f99ba-b0fe-46e5-a337-2119cdd3679e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:57.881218 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f99ba-b0fe-46e5-a337-2119cdd3679e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:57.894405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 250/494] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:57.894405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283f14a-4141-4770-a1ce-dd6c51a526db None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:57.894405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283f14a-4141-4770-a1ce-dd6c51a526db None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:57.894405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9283f14a-4141-4770-a1ce-dd6c51a526db None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:57.894405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 251/495] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:57.894405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283f14a-4141-4770-a1ce-dd6c51a526db None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:57.906631 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:57.958009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466491e5-18cf-4f28-998d-3d2e3934a8c0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:57.993966 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890b22-55a9-42b2-b321-c0c6bcf9fd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:57.994600 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890b22-55a9-42b2-b321-c0c6bcf9fd04 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:57.994878 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890b22-55a9-42b2-b321-c0c6bcf9fd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:57.995147 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48890b22-55a9-42b2-b321-c0c6bcf9fd04 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:57.995786 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48890b22-55a9-42b2-b321-c0c6bcf9fd04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:57.996087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48890b22-55a9-42b2-b321-c0c6bcf9fd04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:57.997477 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48890b22-55a9-42b2-b321-c0c6bcf9fd04 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:58.007210 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9283f14a-4141-4770-a1ce-dd6c51a526db None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:58.013906 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 245/496] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:58.013906 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890b22-55a9-42b2-b321-c0c6bcf9fd04 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:58.044638 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:58.055761 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46379da7-ee9d-40b4-b348-6a0328c63ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:58.056360 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46379da7-ee9d-40b4-b348-6a0328c63ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.056793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46379da7-ee9d-40b4-b348-6a0328c63ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.057063 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46379da7-ee9d-40b4-b348-6a0328c63ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.058074 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46379da7-ee9d-40b4-b348-6a0328c63ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:58.059263 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46379da7-ee9d-40b4-b348-6a0328c63ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:58.060283 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46379da7-ee9d-40b4-b348-6a0328c63ba3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:58.074332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 252/497] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:58.075522 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc02547-5607-48fc-b224-b710c98517f8 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.075803 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc02547-5607-48fc-b224-b710c98517f8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.076072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc02547-5607-48fc-b224-b710c98517f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.098048 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-1cc02547-5607-48fc-b224-b710c98517f8 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:58.099245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-1cc02547-5607-48fc-b224-b710c98517f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:58.117547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48890b22-55a9-42b2-b321-c0c6bcf9fd04 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:58.131954 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:58.154259 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ff32-9a75-4f84-b330-ca5e4aff770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:58.154883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ff32-9a75-4f84-b330-ca5e4aff770b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.155159 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ff32-9a75-4f84-b330-ca5e4aff770b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.155421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ff32-9a75-4f84-b330-ca5e4aff770b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.166996 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ff32-9a75-4f84-b330-ca5e4aff770b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:58.168453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ff32-9a75-4f84-b330-ca5e4aff770b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:58.169021 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 253/498] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:58.169891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc02547-5607-48fc-b224-b710c98517f8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-75a3ff32-9a75-4f84-b330-ca5e4aff770b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:11:58.195160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:58.196107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:11:58.196933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:11:58.196933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:58.196933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:58.199460 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 246/499] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:58.199460 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ff32-9a75-4f84-b330-ca5e4aff770b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:58.285008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc02547-5607-48fc-b224-b710c98517f8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:58.302322 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:58.308315 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ff32-9a75-4f84-b330-ca5e4aff770b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:58.320418 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b212b60-5935-45e3-a865-d1ad91a277c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:58.321040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b212b60-5935-45e3-a865-d1ad91a277c5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.321324 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b212b60-5935-45e3-a865-d1ad91a277c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.321596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b212b60-5935-45e3-a865-d1ad91a277c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.329613 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b212b60-5935-45e3-a865-d1ad91a277c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:58.331853 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b212b60-5935-45e3-a865-d1ad91a277c5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:58.343843 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee718e-09b0-4a24-828c-58d311ed3106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:58.344457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee718e-09b0-4a24-828c-58d311ed3106 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.344732 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee718e-09b0-4a24-828c-58d311ed3106 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.344999 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee718e-09b0-4a24-828c-58d311ed3106 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-2b212b60-5935-45e3-a865-d1ad91a277c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:11:58.345509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:58.346531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:58.348072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:58.348072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:58.348072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:11:58.348072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:11:58.348072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:11:58.348072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:11:58.348072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:11:58.348072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:11:58.348072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:11:58.348072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:58.348072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 254/500] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:58.352434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b8fb7-fffa-4ef4-89ff-b23ec5179a95 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.353092 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b8fb7-fffa-4ef4-89ff-b23ec5179a95 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.353679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b8fb7-fffa-4ef4-89ff-b23ec5179a95 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.358133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 255/501] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:11:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:11:58.358133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b8fb7-fffa-4ef4-89ff-b23ec5179a95 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:58.360800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee718e-09b0-4a24-828c-58d311ed3106 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:58.362786 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee718e-09b0-4a24-828c-58d311ed3106 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-abee718e-09b0-4a24-828c-58d311ed3106 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:11:58.375405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:58.376341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:58.377770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:58.377770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:58.377770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:11:58.377770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:11:58.377770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:11:58.377770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:11:58.377770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:11:58.377770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:11:58.377770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:11:58.377770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:58.381617 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 247/502] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 07:11:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:58.382470 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee718e-09b0-4a24-828c-58d311ed3106 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:58.408149 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:58.465143 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b8fb7-fffa-4ef4-89ff-b23ec5179a95 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:58.484237 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee718e-09b0-4a24-828c-58d311ed3106 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:58.498783 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be6e75-bd62-4234-9ede-40a11b2168e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:58.499396 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be6e75-bd62-4234-9ede-40a11b2168e9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.499661 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be6e75-bd62-4234-9ede-40a11b2168e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.499930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be6e75-bd62-4234-9ede-40a11b2168e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.500572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be6e75-bd62-4234-9ede-40a11b2168e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:58.500869 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be6e75-bd62-4234-9ede-40a11b2168e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:58.502939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be6e75-bd62-4234-9ede-40a11b2168e9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:58.514017 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 256/503] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:58.515195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada60d12-15af-4ec4-b95b-2e68c94afec0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.515474 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada60d12-15af-4ec4-b95b-2e68c94afec0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.515743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada60d12-15af-4ec4-b95b-2e68c94afec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.519470 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdb2bd-5649-4ddf-944a-33a8f1498ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:58.520072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdb2bd-5649-4ddf-944a-33a8f1498ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.520346 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdb2bd-5649-4ddf-944a-33a8f1498ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.520611 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdb2bd-5649-4ddf-944a-33a8f1498ad2 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.521330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdb2bd-5649-4ddf-944a-33a8f1498ad2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:58.521632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdb2bd-5649-4ddf-944a-33a8f1498ad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:58.523088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdb2bd-5649-4ddf-944a-33a8f1498ad2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:58.534498 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-ada60d12-15af-4ec4-b95b-2e68c94afec0 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:11:58.535674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-ada60d12-15af-4ec4-b95b-2e68c94afec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:11:58.561344 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 248/504] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 07:11:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:58.562085 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdb2bd-5649-4ddf-944a-33a8f1498ad2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:58.565933 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:58.604678 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 257/505] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:11:58.605637 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada60d12-15af-4ec4-b95b-2e68c94afec0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:58.657452 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:58.678741 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdb2bd-5649-4ddf-944a-33a8f1498ad2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:58.713911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada60d12-15af-4ec4-b95b-2e68c94afec0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:58.724541 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21b4d-8a99-4bbc-aff7-7de80cd9287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:58.725545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21b4d-8a99-4bbc-aff7-7de80cd9287d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.725827 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21b4d-8a99-4bbc-aff7-7de80cd9287d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.726424 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21b4d-8a99-4bbc-aff7-7de80cd9287d None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.727157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21b4d-8a99-4bbc-aff7-7de80cd9287d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:58.727460 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21b4d-8a99-4bbc-aff7-7de80cd9287d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:58.729742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21b4d-8a99-4bbc-aff7-7de80cd9287d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:58.750455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb01ca-c12f-488f-b87b-b664efce8652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:58.751074 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb01ca-c12f-488f-b87b-b664efce8652 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.751351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb01ca-c12f-488f-b87b-b664efce8652 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.757059 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb01ca-c12f-488f-b87b-b664efce8652 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.757196 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 249/506] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 07:11:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:58.757196 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21b4d-8a99-4bbc-aff7-7de80cd9287d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:58.770276 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb01ca-c12f-488f-b87b-b664efce8652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-3feb01ca-c12f-488f-b87b-b664efce8652 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:11:58.776311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:58.777196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:11:58.777970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:58.779191 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 258/507] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:11:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:58.779191 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb01ca-c12f-488f-b87b-b664efce8652 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:58.808391 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:58.869028 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21b4d-8a99-4bbc-aff7-7de80cd9287d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:58.884273 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb01ca-c12f-488f-b87b-b664efce8652 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:58.902841 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f6a58-aad3-45fd-b852-86b2c7120226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:58.903463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f6a58-aad3-45fd-b852-86b2c7120226 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.903744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f6a58-aad3-45fd-b852-86b2c7120226 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.904013 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f6a58-aad3-45fd-b852-86b2c7120226 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.911649 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f6a58-aad3-45fd-b852-86b2c7120226 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:58.913129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f6a58-aad3-45fd-b852-86b2c7120226 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:58.915657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:58.917328 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc9edd-c3f8-4591-a196-89b81be05f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:58.917922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc9edd-c3f8-4591-a196-89b81be05f95 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:58.918337 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc9edd-c3f8-4591-a196-89b81be05f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:58.918609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc9edd-c3f8-4591-a196-89b81be05f95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-485f6a58-aad3-45fd-b852-86b2c7120226 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:11:58.926811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:58.927846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 250/508] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:11:58 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:58.928897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f6a58-aad3-45fd-b852-86b2c7120226 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:58.992862 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc9edd-c3f8-4591-a196-89b81be05f95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:58.994963 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc9edd-c3f8-4591-a196-89b81be05f95 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:59.021045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:59.026777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f6a58-aad3-45fd-b852-86b2c7120226 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:59.060752 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790aa722-b451-49c8-9f08-cf1f676a1134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:59.061355 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790aa722-b451-49c8-9f08-cf1f676a1134 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:59.061633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790aa722-b451-49c8-9f08-cf1f676a1134 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:59.061900 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790aa722-b451-49c8-9f08-cf1f676a1134 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:59.092094 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 259/509] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:59.093048 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc9edd-c3f8-4591-a196-89b81be05f95 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:59.127800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:59.129901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790aa722-b451-49c8-9f08-cf1f676a1134 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:59.131451 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790aa722-b451-49c8-9f08-cf1f676a1134 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:59.191513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc9edd-c3f8-4591-a196-89b81be05f95 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:59.216772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:59.224837 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668169-0fc1-4aa4-85a8-b6a7f09c5b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:59.225428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668169-0fc1-4aa4-85a8-b6a7f09c5b84 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:59.225706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668169-0fc1-4aa4-85a8-b6a7f09c5b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:59.225974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0668169-0fc1-4aa4-85a8-b6a7f09c5b84 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:59.226658 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0668169-0fc1-4aa4-85a8-b6a7f09c5b84 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:59.226956 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0668169-0fc1-4aa4-85a8-b6a7f09c5b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:59.228311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0668169-0fc1-4aa4-85a8-b6a7f09c5b84 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:59.228589 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 251/510] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:11:59.229416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790aa722-b451-49c8-9f08-cf1f676a1134 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:59.236938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 260/511] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:11:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:59.237734 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668169-0fc1-4aa4-85a8-b6a7f09c5b84 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:59.327766 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:59.330641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790aa722-b451-49c8-9f08-cf1f676a1134 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:59.334805 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0668169-0fc1-4aa4-85a8-b6a7f09c5b84 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:59.364404 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e9a10-6fbd-4af4-92e6-c967cc875098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:59.365016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e9a10-6fbd-4af4-92e6-c967cc875098 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:59.365292 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e9a10-6fbd-4af4-92e6-c967cc875098 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:59.365557 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e9a10-6fbd-4af4-92e6-c967cc875098 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:59.368804 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c0629-914c-49d5-8dde-846360a3dd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:59.369389 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0629-914c-49d5-8dde-846360a3dd00 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:59.369669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0629-914c-49d5-8dde-846360a3dd00 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:59.369947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0629-914c-49d5-8dde-846360a3dd00 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:59.370701 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c0629-914c-49d5-8dde-846360a3dd00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:59.371009 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c0629-914c-49d5-8dde-846360a3dd00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:59.372847 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c0629-914c-49d5-8dde-846360a3dd00 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:59.375294 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e9a10-6fbd-4af4-92e6-c967cc875098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:59.376713 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e9a10-6fbd-4af4-92e6-c967cc875098 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-584e9a10-6fbd-4af4-92e6-c967cc875098 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:11:59.391420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:59.392498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:11:59.393357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:11:59.393357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:59.393357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:59.393357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 252/512] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:59.393887 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e9a10-6fbd-4af4-92e6-c967cc875098 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:59.409238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 261/513] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 07:11:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:59.410071 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c0629-914c-49d5-8dde-846360a3dd00 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:59.456112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:59.492193 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e9a10-6fbd-4af4-92e6-c967cc875098 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:59.509250 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c0629-914c-49d5-8dde-846360a3dd00 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:59.524556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29f856-505e-47ea-9d37-c7afcbf176c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:59.525182 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29f856-505e-47ea-9d37-c7afcbf176c2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:59.525483 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29f856-505e-47ea-9d37-c7afcbf176c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:59.525758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29f856-505e-47ea-9d37-c7afcbf176c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:59.535893 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29f856-505e-47ea-9d37-c7afcbf176c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:59.537345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29f856-505e-47ea-9d37-c7afcbf176c2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:59.542950 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58145a-b75e-4658-94d9-44cfa2378975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:59.543562 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58145a-b75e-4658-94d9-44cfa2378975 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:59.543841 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58145a-b75e-4658-94d9-44cfa2378975 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:59.544112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e58145a-b75e-4658-94d9-44cfa2378975 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-bb29f856-505e-47ea-9d37-c7afcbf176c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:11:59.551388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:59.552428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:11:59.553298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:11:59.553298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:59.553298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:59.553298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 253/514] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:59.553298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29f856-505e-47ea-9d37-c7afcbf176c2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:59.557111 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58145a-b75e-4658-94d9-44cfa2378975 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:59.558612 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e58145a-b75e-4658-94d9-44cfa2378975 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:59.560189 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-0e58145a-b75e-4658-94d9-44cfa2378975 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:11:59.574334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:59.575553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:11:59.576365 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:11:59.576365 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:59.576365 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:11:59.576365 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 262/515] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:59.576589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58145a-b75e-4658-94d9-44cfa2378975 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:59.660217 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29f856-505e-47ea-9d37-c7afcbf176c2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:59.678271 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:59.683425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e58145a-b75e-4658-94d9-44cfa2378975 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:59.694493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fc6f6-f0fa-4152-a742-22789ef8c526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:59.695119 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fc6f6-f0fa-4152-a742-22789ef8c526 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:59.695397 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fc6f6-f0fa-4152-a742-22789ef8c526 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:59.695685 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3fc6f6-f0fa-4152-a742-22789ef8c526 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:59.706149 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fc6f6-f0fa-4152-a742-22789ef8c526 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:59.707649 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3fc6f6-f0fa-4152-a742-22789ef8c526 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:59.718876 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf324bc-e804-4a54-b33b-bfa21121f16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:59.719461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf324bc-e804-4a54-b33b-bfa21121f16f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:59.719736 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf324bc-e804-4a54-b33b-bfa21121f16f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:59.720054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf324bc-e804-4a54-b33b-bfa21121f16f None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:59.721340 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf324bc-e804-4a54-b33b-bfa21121f16f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:59.721850 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf324bc-e804-4a54-b33b-bfa21121f16f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0a3fc6f6-f0fa-4152-a742-22789ef8c526 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:11:59.722385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:11:59.723413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:11:59.729238 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:11:59.729238 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:11:59.729238 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:11:59.729413 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf324bc-e804-4a54-b33b-bfa21121f16f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:59.729483 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 254/516] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:11:59.729483 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fc6f6-f0fa-4152-a742-22789ef8c526 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:59.734619 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 263/517] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:59.735422 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf324bc-e804-4a54-b33b-bfa21121f16f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:59.784968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:59.828817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3fc6f6-f0fa-4152-a742-22789ef8c526 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:59.832346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf324bc-e804-4a54-b33b-bfa21121f16f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:59.863290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771745-6ee5-4098-ac85-834fad8efc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:59.863889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771745-6ee5-4098-ac85-834fad8efc09 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:59.864162 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771745-6ee5-4098-ac85-834fad8efc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:59.864429 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62771745-6ee5-4098-ac85-834fad8efc09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:59.866959 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305073-0250-4ce8-afa6-d473e0d99190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:11:59.867551 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305073-0250-4ce8-afa6-d473e0d99190 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:11:59.867826 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305073-0250-4ce8-afa6-d473e0d99190 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:11:59.868092 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2305073-0250-4ce8-afa6-d473e0d99190 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:11:59.868728 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2305073-0250-4ce8-afa6-d473e0d99190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:11:59.869025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2305073-0250-4ce8-afa6-d473e0d99190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:59.870455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2305073-0250-4ce8-afa6-d473e0d99190 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:59.882197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 264/518] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:11:59.882998 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305073-0250-4ce8-afa6-d473e0d99190 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:11:59.901490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:11:59.935435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62771745-6ee5-4098-ac85-834fad8efc09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:11:59.935588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62771745-6ee5-4098-ac85-834fad8efc09 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:11:59.982665 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2305073-0250-4ce8-afa6-d473e0d99190 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:11:59.989676 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:00.016193 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e0a3f-129d-4e1a-ab40-6a3f3715ae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:00.016777 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0a3f-129d-4e1a-ab40-6a3f3715ae03 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:00.017062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0a3f-129d-4e1a-ab40-6a3f3715ae03 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:00.017332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e0a3f-129d-4e1a-ab40-6a3f3715ae03 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:00.017966 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e0a3f-129d-4e1a-ab40-6a3f3715ae03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:00.018309 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e0a3f-129d-4e1a-ab40-6a3f3715ae03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:00.019681 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e0a3f-129d-4e1a-ab40-6a3f3715ae03 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:00.030534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 265/519] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:00.031310 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e0a3f-129d-4e1a-ab40-6a3f3715ae03 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.034294 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 255/520] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:00.035473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771745-6ee5-4098-ac85-834fad8efc09 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.112853 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:00.134061 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e0a3f-129d-4e1a-ab40-6a3f3715ae03 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:00.134498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62771745-6ee5-4098-ac85-834fad8efc09 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:00.168346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db055e-7319-47c7-84cb-1225d607ce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:00.168552 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce2562-b4e4-4371-b0e8-fefd6614c167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:00.168939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db055e-7319-47c7-84cb-1225d607ce78 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:00.169045 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce2562-b4e4-4371-b0e8-fefd6614c167 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:00.169217 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce2562-b4e4-4371-b0e8-fefd6614c167 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:00.169304 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db055e-7319-47c7-84cb-1225d607ce78 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:00.169486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce2562-b4e4-4371-b0e8-fefd6614c167 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:00.169574 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db055e-7319-47c7-84cb-1225d607ce78 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:00.170120 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce2562-b4e4-4371-b0e8-fefd6614c167 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:00.170209 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db055e-7319-47c7-84cb-1225d607ce78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:00.170448 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db055e-7319-47c7-84cb-1225d607ce78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:00.171563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce2562-b4e4-4371-b0e8-fefd6614c167 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:00.171805 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db055e-7319-47c7-84cb-1225d607ce78 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:00.184073 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 266/521] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:00.184943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db055e-7319-47c7-84cb-1225d607ce78 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.239000 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 256/522] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:12:00 2022] POST /identity/v3/users => generated 247 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:00.239789 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce2562-b4e4-4371-b0e8-fefd6614c167 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.267597 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:00.293748 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db055e-7319-47c7-84cb-1225d607ce78 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:00.335598 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ca50-5648-4235-b468-310cf5027dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:00.336234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ca50-5648-4235-b468-310cf5027dad None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:00.336507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ca50-5648-4235-b468-310cf5027dad None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:00.336777 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ca50-5648-4235-b468-310cf5027dad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:00.344552 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94ca50-5648-4235-b468-310cf5027dad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:00.346327 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94ca50-5648-4235-b468-310cf5027dad None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:00.348384 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6f94ca50-5648-4235-b468-310cf5027dad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:00.360278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:00.364399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:00.366133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:00.366133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:00.366133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:00.366133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:00.366133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:00.366133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:00.366133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:00.366133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:00.366133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 267/523] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:00.366133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ca50-5648-4235-b468-310cf5027dad None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.377471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce2562-b4e4-4371-b0e8-fefd6614c167 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:00.419912 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e31b-72c1-47d3-baa6-dfa4fe68f1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:00.420829 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e31b-72c1-47d3-baa6-dfa4fe68f1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:00.421112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e31b-72c1-47d3-baa6-dfa4fe68f1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:00.421378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187e31b-72c1-47d3-baa6-dfa4fe68f1d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:00.431889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187e31b-72c1-47d3-baa6-dfa4fe68f1d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:00.434173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187e31b-72c1-47d3-baa6-dfa4fe68f1d0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-7187e31b-72c1-47d3-baa6-dfa4fe68f1d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:00.447691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:00.448550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:00.449480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:00.449480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:00.449480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:00.449480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:00.449480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:00.449480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:00.449480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:00.449480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:00.449480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 257/524] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:00.449927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e31b-72c1-47d3-baa6-dfa4fe68f1d0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.485261 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ca50-5648-4235-b468-310cf5027dad None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:00.520833 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f098f-c4b7-4b64-8186-74b1173cadb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:00.521374 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f098f-c4b7-4b64-8186-74b1173cadb5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:00.521653 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f098f-c4b7-4b64-8186-74b1173cadb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:00.521922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f098f-c4b7-4b64-8186-74b1173cadb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:00.527230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:00.532528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f098f-c4b7-4b64-8186-74b1173cadb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:00.534807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f098f-c4b7-4b64-8186-74b1173cadb5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a95f098f-c4b7-4b64-8186-74b1173cadb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:00.549521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:00.550698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:00.551563 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:00.551563 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:00.551563 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:00.551563 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 268/525] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:00.551563 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f098f-c4b7-4b64-8186-74b1173cadb5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.563931 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187e31b-72c1-47d3-baa6-dfa4fe68f1d0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:00.605411 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5301c2-83a2-4c4c-bd73-a7ed43125cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:00.606050 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5301c2-83a2-4c4c-bd73-a7ed43125cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:00.606354 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5301c2-83a2-4c4c-bd73-a7ed43125cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:00.606626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5301c2-83a2-4c4c-bd73-a7ed43125cd3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:00.608363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:00.617359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5301c2-83a2-4c4c-bd73-a7ed43125cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:00.620504 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5301c2-83a2-4c4c-bd73-a7ed43125cd3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ba5301c2-83a2-4c4c-bd73-a7ed43125cd3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:00.631345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:00.632255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:00.633131 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:00.633131 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:00.633131 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:00.633131 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:00.633131 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:00.633131 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:00.633131 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:00.633131 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:00.633131 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:12:00.633131 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:00.634428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 258/526] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:00.635442 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5301c2-83a2-4c4c-bd73-a7ed43125cd3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.664198 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f098f-c4b7-4b64-8186-74b1173cadb5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:00.701050 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad23940-76b0-44c8-a6e2-236d9dc41393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:00.701656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad23940-76b0-44c8-a6e2-236d9dc41393 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:00.701915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad23940-76b0-44c8-a6e2-236d9dc41393 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:00.702224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad23940-76b0-44c8-a6e2-236d9dc41393 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:00.702910 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad23940-76b0-44c8-a6e2-236d9dc41393 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:00.703211 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad23940-76b0-44c8-a6e2-236d9dc41393 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:00.704637 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad23940-76b0-44c8-a6e2-236d9dc41393 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:00.724205 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 269/527] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:00.725042 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad23940-76b0-44c8-a6e2-236d9dc41393 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.753763 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5301c2-83a2-4c4c-bd73-a7ed43125cd3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:00.786887 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:00.792960 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faabb86-7c16-49ee-8902-36620e6cfcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:00.793616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabb86-7c16-49ee-8902-36620e6cfcde None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:00.793937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabb86-7c16-49ee-8902-36620e6cfcde None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:00.794241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faabb86-7c16-49ee-8902-36620e6cfcde None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:00.794931 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faabb86-7c16-49ee-8902-36620e6cfcde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:00.795335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faabb86-7c16-49ee-8902-36620e6cfcde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:00.797050 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faabb86-7c16-49ee-8902-36620e6cfcde None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:00.821323 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 259/528] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:00.821323 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faabb86-7c16-49ee-8902-36620e6cfcde None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.834849 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad23940-76b0-44c8-a6e2-236d9dc41393 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:00.846472 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:00.869907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690cf4a-ebb6-455d-8c19-f9afe287132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:00.870854 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690cf4a-ebb6-455d-8c19-f9afe287132d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:00.871305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690cf4a-ebb6-455d-8c19-f9afe287132d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:00.871765 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690cf4a-ebb6-455d-8c19-f9afe287132d None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:00.872624 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690cf4a-ebb6-455d-8c19-f9afe287132d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:00.873061 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690cf4a-ebb6-455d-8c19-f9afe287132d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:00.874628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690cf4a-ebb6-455d-8c19-f9afe287132d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:00.886939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 270/529] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:00.887943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690cf4a-ebb6-455d-8c19-f9afe287132d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.937817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faabb86-7c16-49ee-8902-36620e6cfcde None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:00.973541 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddf8b0-5d01-459e-a5ad-10ec86ed0be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:00.974164 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddf8b0-5d01-459e-a5ad-10ec86ed0be1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:00.974444 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddf8b0-5d01-459e-a5ad-10ec86ed0be1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:00.974716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddf8b0-5d01-459e-a5ad-10ec86ed0be1 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:00.975437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddf8b0-5d01-459e-a5ad-10ec86ed0be1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:00.975736 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddf8b0-5d01-459e-a5ad-10ec86ed0be1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:00.977145 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddf8b0-5d01-459e-a5ad-10ec86ed0be1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:00.994537 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 260/530] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 23 07:12:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:00.998417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddf8b0-5d01-459e-a5ad-10ec86ed0be1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:00.999849 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690cf4a-ebb6-455d-8c19-f9afe287132d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:01.036630 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4ca9-1085-4658-904b-ac27d65b1261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:01.037280 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4ca9-1085-4658-904b-ac27d65b1261 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:01.037500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4ca9-1085-4658-904b-ac27d65b1261 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:01.037766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b4ca9-1085-4658-904b-ac27d65b1261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:01.038527 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b4ca9-1085-4658-904b-ac27d65b1261 None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=790353a3d5d543bca467802f1d9fd6fb) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:01.038830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b4ca9-1085-4658-904b-ac27d65b1261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:01.040250 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b4ca9-1085-4658-904b-ac27d65b1261 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:01.046066 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 271/531] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:00 2022] GET /identity/v3/role_assignments?user.id=790353a3d5d543bca467802f1d9fd6fb&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:01.049216 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:01.055230 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4ca9-1085-4658-904b-ac27d65b1261 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:01.108694 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddf8b0-5d01-459e-a5ad-10ec86ed0be1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:01.110256 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:01.150713 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ec734-cad0-4901-be26-dd696131ef8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:01.151440 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec734-cad0-4901-be26-dd696131ef8f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:01.151809 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec734-cad0-4901-be26-dd696131ef8f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:01.152149 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ec734-cad0-4901-be26-dd696131ef8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:01.153027 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ec734-cad0-4901-be26-dd696131ef8f None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=bb99f54d9320496cbcc52d535fa64789) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:01.153448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ec734-cad0-4901-be26-dd696131ef8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:01.155121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ec734-cad0-4901-be26-dd696131ef8f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:01.166561 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 261/532] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:00 2022] GET /identity/v3/role_assignments?user.id=bb99f54d9320496cbcc52d535fa64789&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:01.167643 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ec734-cad0-4901-be26-dd696131ef8f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:01.221216 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b4ca9-1085-4658-904b-ac27d65b1261 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:01.280380 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf804cc-930b-45b8-a1ce-6c1d22d07dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:01.280879 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf804cc-930b-45b8-a1ce-6c1d22d07dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:01.281157 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf804cc-930b-45b8-a1ce-6c1d22d07dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:01.281425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf804cc-930b-45b8-a1ce-6c1d22d07dd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:01.291315 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf804cc-930b-45b8-a1ce-6c1d22d07dd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:01.293705 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf804cc-930b-45b8-a1ce-6c1d22d07dd1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8cf804cc-930b-45b8-a1ce-6c1d22d07dd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:01.312635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:01.313526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:01.314968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:01.314968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:01.314968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:01.314968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:01.314968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:01.314968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:01.314968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:01.314968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:01.321608 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 272/533] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:01.321834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ec734-cad0-4901-be26-dd696131ef8f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:01.323536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf804cc-930b-45b8-a1ce-6c1d22d07dd1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:01.356435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:01.380672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b228-9af5-4b15-9d49-d1c798de1638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:01.380672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b228-9af5-4b15-9d49-d1c798de1638 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:01.380672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b228-9af5-4b15-9d49-d1c798de1638 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:01.380672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b228-9af5-4b15-9d49-d1c798de1638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:01.478985 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4b228-9af5-4b15-9d49-d1c798de1638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:01.480449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4b228-9af5-4b15-9d49-d1c798de1638 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:01.483607 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:01.499384 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf804cc-930b-45b8-a1ce-6c1d22d07dd1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:01.566164 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8624-362b-423f-adc6-e0c7c15cf05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:01.566823 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8624-362b-423f-adc6-e0c7c15cf05e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:01.567106 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8624-362b-423f-adc6-e0c7c15cf05e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:01.567374 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8624-362b-423f-adc6-e0c7c15cf05e None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:01.568077 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8624-362b-423f-adc6-e0c7c15cf05e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:01.568378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8624-362b-423f-adc6-e0c7c15cf05e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:01.569815 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8624-362b-423f-adc6-e0c7c15cf05e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:01.590907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 273/534] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:01.598462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8624-362b-423f-adc6-e0c7c15cf05e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:01.708585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 262/535] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:01.714015 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b228-9af5-4b15-9d49-d1c798de1638 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:01.734716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:01.738257 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8624-362b-423f-adc6-e0c7c15cf05e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:01.791765 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceea62-995f-4ba2-808b-ccb8e43abca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:01.792370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceea62-995f-4ba2-808b-ccb8e43abca9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:01.792651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceea62-995f-4ba2-808b-ccb8e43abca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:01.792922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceea62-995f-4ba2-808b-ccb8e43abca9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:01.793653 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ceea62-995f-4ba2-808b-ccb8e43abca9 None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=a59542e893d244ca9a268fc388052329) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:01.793962 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ceea62-995f-4ba2-808b-ccb8e43abca9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:01.798295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ceea62-995f-4ba2-808b-ccb8e43abca9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:01.813218 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 274/536] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:01 2022] GET /identity/v3/role_assignments?user.id=a59542e893d244ca9a268fc388052329&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:01.865849 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b228-9af5-4b15-9d49-d1c798de1638 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:01.903349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf271b-9ea5-48e4-85a3-bc09fb4eb665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:01.903992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf271b-9ea5-48e4-85a3-bc09fb4eb665 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:01.904274 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf271b-9ea5-48e4-85a3-bc09fb4eb665 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:01.904544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf271b-9ea5-48e4-85a3-bc09fb4eb665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:01.916174 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf271b-9ea5-48e4-85a3-bc09fb4eb665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:01.917741 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf271b-9ea5-48e4-85a3-bc09fb4eb665 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-96bf271b-9ea5-48e4-85a3-bc09fb4eb665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:01.934681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:01.938173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:01.939784 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:01.939784 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:01.939784 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:01.939784 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 263/537] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:01.943462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceea62-995f-4ba2-808b-ccb8e43abca9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:01.968969 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:02.093062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceea62-995f-4ba2-808b-ccb8e43abca9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:02.143742 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdf4a9-cd1e-4287-a0f9-a439897d51de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:02.144340 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf4a9-cd1e-4287-a0f9-a439897d51de None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:02.144612 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf4a9-cd1e-4287-a0f9-a439897d51de None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:02.144876 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdf4a9-cd1e-4287-a0f9-a439897d51de None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:02.145525 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdf4a9-cd1e-4287-a0f9-a439897d51de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:02.145815 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdf4a9-cd1e-4287-a0f9-a439897d51de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:02.147201 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdf4a9-cd1e-4287-a0f9-a439897d51de None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:02.169418 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 275/538] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:02.175505 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf271b-9ea5-48e4-85a3-bc09fb4eb665 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:02.263690 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:02.301105 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf271b-9ea5-48e4-85a3-bc09fb4eb665 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:02.353804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7232bbb-6ee9-452e-9b75-dac84543cb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:02.354480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232bbb-6ee9-452e-9b75-dac84543cb70 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:02.354761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232bbb-6ee9-452e-9b75-dac84543cb70 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:02.355029 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7232bbb-6ee9-452e-9b75-dac84543cb70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:02.362800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7232bbb-6ee9-452e-9b75-dac84543cb70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:02.364247 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7232bbb-6ee9-452e-9b75-dac84543cb70 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d7232bbb-6ee9-452e-9b75-dac84543cb70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:02.381601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:02.382703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:02.383714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:02.383714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:02.383714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:02.383714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:02.383714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:02.383714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:02.383714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:02.383714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:02.383714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 264/539] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:02.389782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdf4a9-cd1e-4287-a0f9-a439897d51de None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:02.493795 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:02.516873 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdf4a9-cd1e-4287-a0f9-a439897d51de None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:02.535156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9f47-7c9e-4cb1-9cdf-4fa07d1dcc0f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:02.535547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9f47-7c9e-4cb1-9cdf-4fa07d1dcc0f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:02.535917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc9f47-7c9e-4cb1-9cdf-4fa07d1dcc0f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:02.537503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 265/540] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:12:02.543073 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf5d45-35a8-453f-ab86-712ec1af3e78 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:02.543499 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf5d45-35a8-453f-ab86-712ec1af3e78 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:02.543877 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf5d45-35a8-453f-ab86-712ec1af3e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:02.557140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc839d-5577-4bbb-abd7-1f299f0dc5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:02.558181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc839d-5577-4bbb-abd7-1f299f0dc5dd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:02.558601 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc839d-5577-4bbb-abd7-1f299f0dc5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:02.559000 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc839d-5577-4bbb-abd7-1f299f0dc5dd None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:02.559837 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc839d-5577-4bbb-abd7-1f299f0dc5dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:02.560274 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc839d-5577-4bbb-abd7-1f299f0dc5dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:02.561995 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc839d-5577-4bbb-abd7-1f299f0dc5dd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:02.576317 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 276/541] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:02.581220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-aeaf5d45-35a8-453f-ab86-712ec1af3e78 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:02.581220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-aeaf5d45-35a8-453f-ab86-712ec1af3e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:02.583290 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc839d-5577-4bbb-abd7-1f299f0dc5dd None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:02.716992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 266/542] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:02.743219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc839d-5577-4bbb-abd7-1f299f0dc5dd None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:02.780870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc705a6-0a18-480d-9774-1045d4705629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:02.781786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc705a6-0a18-480d-9774-1045d4705629 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:02.782293 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc705a6-0a18-480d-9774-1045d4705629 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:02.782878 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc705a6-0a18-480d-9774-1045d4705629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:02.783782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc705a6-0a18-480d-9774-1045d4705629 None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=e952426a4d6949b3bd9ee5923abd637f) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:02.784269 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc705a6-0a18-480d-9774-1045d4705629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:02.785866 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc705a6-0a18-480d-9774-1045d4705629 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:02.792001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 277/543] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:02 2022] GET /identity/v3/role_assignments?user.id=e952426a4d6949b3bd9ee5923abd637f&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:03.071358 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf5d45-35a8-453f-ab86-712ec1af3e78 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:03.141526 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:03.196901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf5d45-35a8-453f-ab86-712ec1af3e78 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:03.231589 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af92e70a-dfa7-4d2f-a2e3-1ccd0f136a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:03.232226 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e70a-dfa7-4d2f-a2e3-1ccd0f136a18 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:03.232503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e70a-dfa7-4d2f-a2e3-1ccd0f136a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:03.232773 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92e70a-dfa7-4d2f-a2e3-1ccd0f136a18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:03.251156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af92e70a-dfa7-4d2f-a2e3-1ccd0f136a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-af92e70a-dfa7-4d2f-a2e3-1ccd0f136a18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:03.257357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:03.258341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:03.259156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 267/544] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:03.266156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc705a6-0a18-480d-9774-1045d4705629 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:03.272703 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:03.378446 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e180c-539f-40b0-a6ed-748f277729e8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:03.378743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e180c-539f-40b0-a6ed-748f277729e8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:03.378928 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e180c-539f-40b0-a6ed-748f277729e8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:03.380502 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 268/545] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:03.385356 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734df782-be7a-4183-b5ed-e0b5a531265f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:03.385641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734df782-be7a-4183-b5ed-e0b5a531265f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:03.385915 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734df782-be7a-4183-b5ed-e0b5a531265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:03.402328 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc705a6-0a18-480d-9774-1045d4705629 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:03.423101 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-734df782-be7a-4183-b5ed-e0b5a531265f None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:03.425143 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-734df782-be7a-4183-b5ed-e0b5a531265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:03.441011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81861099-776a-4381-b06b-fd25a15934e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:03.441907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81861099-776a-4381-b06b-fd25a15934e5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:03.442445 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81861099-776a-4381-b06b-fd25a15934e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:03.444785 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81861099-776a-4381-b06b-fd25a15934e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:03.447014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81861099-776a-4381-b06b-fd25a15934e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:03.448198 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81861099-776a-4381-b06b-fd25a15934e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:03.449952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81861099-776a-4381-b06b-fd25a15934e5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:03.469906 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 278/546] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:03.475958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81861099-776a-4381-b06b-fd25a15934e5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:03.557610 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:03.586400 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 269/547] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:12:03.603539 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81861099-776a-4381-b06b-fd25a15934e5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:03.619354 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c1aa7-4429-46d9-a51a-81ce59da42ff None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:03.619667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c1aa7-4429-46d9-a51a-81ce59da42ff None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:03.619914 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c1aa7-4429-46d9-a51a-81ce59da42ff None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:03.625034 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 270/548] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:12:03.626519 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34d964-7323-44fd-a22f-5224f493684b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:03.626802 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34d964-7323-44fd-a22f-5224f493684b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:03.627073 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34d964-7323-44fd-a22f-5224f493684b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:03.643174 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c24d67-1772-4e92-82f1-b93b083a3ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:03.644131 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24d67-1772-4e92-82f1-b93b083a3ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:03.644614 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24d67-1772-4e92-82f1-b93b083a3ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:03.645136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24d67-1772-4e92-82f1-b93b083a3ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:03.645361 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0a34d964-7323-44fd-a22f-5224f493684b None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:03.646759 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0a34d964-7323-44fd-a22f-5224f493684b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:03.657383 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c24d67-1772-4e92-82f1-b93b083a3ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:03.660189 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c24d67-1772-4e92-82f1-b93b083a3ac9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-48c24d67-1772-4e92-82f1-b93b083a3ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:03.687213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:03.688141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:03.689014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:03.689014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:03.689014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:03.696875 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 279/549] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:03.702149 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c24d67-1772-4e92-82f1-b93b083a3ac9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:03.740739 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:03.799378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 271/550] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:12:03.839786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c24d67-1772-4e92-82f1-b93b083a3ac9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:03.858377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:03.877534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591fbc4-774d-41fd-97c7-b6e990f0b04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:03.878506 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591fbc4-774d-41fd-97c7-b6e990f0b04b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:03.879013 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591fbc4-774d-41fd-97c7-b6e990f0b04b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:03.879534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591fbc4-774d-41fd-97c7-b6e990f0b04b None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:03.880495 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591fbc4-774d-41fd-97c7-b6e990f0b04b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:03.881002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591fbc4-774d-41fd-97c7-b6e990f0b04b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:03.882641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591fbc4-774d-41fd-97c7-b6e990f0b04b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:03.902233 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 280/551] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:03.902808 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34d964-7323-44fd-a22f-5224f493684b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:03.991478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591fbc4-774d-41fd-97c7-b6e990f0b04b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:04.013466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34d964-7323-44fd-a22f-5224f493684b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:04.062845 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556d4bc-fda6-4ba4-81e1-4f2bc7b7bfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:04.063493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556d4bc-fda6-4ba4-81e1-4f2bc7b7bfbe None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:04.063781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556d4bc-fda6-4ba4-81e1-4f2bc7b7bfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:04.064595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556d4bc-fda6-4ba4-81e1-4f2bc7b7bfbe None admin] PATH_INFO: `/v3/users/swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:04.072600 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556d4bc-fda6-4ba4-81e1-4f2bc7b7bfbe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:04.074064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556d4bc-fda6-4ba4-81e1-4f2bc7b7bfbe None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-5556d4bc-fda6-4ba4-81e1-4f2bc7b7bfbe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:04.102481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:04.103447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:04.104325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:04.104325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:04.104325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:04.104325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:04.104325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:04.104325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:04.104325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:04.104325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:04.104325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:04.104325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:04.104325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 272/552] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:04.119412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556d4bc-fda6-4ba4-81e1-4f2bc7b7bfbe None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:04.124035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591fbc4-774d-41fd-97c7-b6e990f0b04b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:04.162228 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2e119-84d5-44c7-838e-e3eb6881b998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:04.163070 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2e119-84d5-44c7-838e-e3eb6881b998 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:04.163647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2e119-84d5-44c7-838e-e3eb6881b998 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:04.164057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2e119-84d5-44c7-838e-e3eb6881b998 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:04.176859 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2e119-84d5-44c7-838e-e3eb6881b998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-10f2e119-84d5-44c7-838e-e3eb6881b998 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:04.181954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:04.183047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:04.183896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:04.185997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 281/553] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:04.193492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2e119-84d5-44c7-838e-e3eb6881b998 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:04.205821 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:04.238986 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:04.279911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556d4bc-fda6-4ba4-81e1-4f2bc7b7bfbe None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:04.308734 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2e119-84d5-44c7-838e-e3eb6881b998 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:04.316537 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11734686-54ec-491f-be0c-21f75ed4659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:04.317053 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734686-54ec-491f-be0c-21f75ed4659f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:04.317330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734686-54ec-491f-be0c-21f75ed4659f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:04.317597 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11734686-54ec-491f-be0c-21f75ed4659f None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:04.318355 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11734686-54ec-491f-be0c-21f75ed4659f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:04.318903 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11734686-54ec-491f-be0c-21f75ed4659f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:04.320281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11734686-54ec-491f-be0c-21f75ed4659f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:04.340062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 273/554] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 07:12:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:04.341104 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11734686-54ec-491f-be0c-21f75ed4659f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:04.350350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671366e-722b-42e8-bc2d-52a463e303a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:04.351340 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671366e-722b-42e8-bc2d-52a463e303a6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:04.351902 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671366e-722b-42e8-bc2d-52a463e303a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:04.352390 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671366e-722b-42e8-bc2d-52a463e303a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:04.353347 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671366e-722b-42e8-bc2d-52a463e303a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:04.353926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671366e-722b-42e8-bc2d-52a463e303a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:04.355620 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671366e-722b-42e8-bc2d-52a463e303a6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:04.369924 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 282/555] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:04.371539 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cee5e-a382-4a1c-9c5e-b86799c2bced None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:04.372005 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cee5e-a382-4a1c-9c5e-b86799c2bced None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:04.372576 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894cee5e-a382-4a1c-9c5e-b86799c2bced None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:04.374170 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 283/556] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:04.375050 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cee5e-a382-4a1c-9c5e-b86799c2bced None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:04.437497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:04.443854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11734686-54ec-491f-be0c-21f75ed4659f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:04.477609 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d7218-9936-4e35-ad81-622f0e665d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:04.478278 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d7218-9936-4e35-ad81-622f0e665d9c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:04.478558 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d7218-9936-4e35-ad81-622f0e665d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:04.478832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d7218-9936-4e35-ad81-622f0e665d9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:04.488266 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:04.489876 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d7218-9936-4e35-ad81-622f0e665d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:04.493436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894cee5e-a382-4a1c-9c5e-b86799c2bced None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e18d7218-9936-4e35-ad81-622f0e665d9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:04.494565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:04.499071 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 274/557] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:04.500040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d7218-9936-4e35-ad81-622f0e665d9c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:04.535449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de8316-904d-44d0-961c-8afb6d8fd2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:04.536288 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de8316-904d-44d0-961c-8afb6d8fd2cd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:04.536743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de8316-904d-44d0-961c-8afb6d8fd2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:04.537159 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de8316-904d-44d0-961c-8afb6d8fd2cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:04.615480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d7218-9936-4e35-ad81-622f0e665d9c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:04.619588 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de8316-904d-44d0-961c-8afb6d8fd2cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:04.621163 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de8316-904d-44d0-961c-8afb6d8fd2cd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:04.652036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b87854-171e-49ad-b804-56f9eb35a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:04.652916 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87854-171e-49ad-b804-56f9eb35a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:04.653346 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87854-171e-49ad-b804-56f9eb35a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:04.653765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b87854-171e-49ad-b804-56f9eb35a9c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:04.665309 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b87854-171e-49ad-b804-56f9eb35a9c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:04.667024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b87854-171e-49ad-b804-56f9eb35a9c5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e2b87854-171e-49ad-b804-56f9eb35a9c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:04.682296 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:04.683922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:04.685011 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:04.685011 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:04.685011 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:04.686410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 275/558] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:04.687749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438578-42c3-4792-add3-db0c5d96377f None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:04.688179 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438578-42c3-4792-add3-db0c5d96377f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:04.688455 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03438578-42c3-4792-add3-db0c5d96377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:04.702154 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:04.708343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-03438578-42c3-4792-add3-db0c5d96377f None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:04.709536 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-03438578-42c3-4792-add3-db0c5d96377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:04.728137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:04.737982 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 284/559] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:04.737982 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de8316-904d-44d0-961c-8afb6d8fd2cd None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:04.795155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 276/560] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:04.795155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438578-42c3-4792-add3-db0c5d96377f None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:04.853864 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de8316-904d-44d0-961c-8afb6d8fd2cd None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:04.891085 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08970035-0183-4324-bb38-a335cdab635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:04.891579 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03438578-42c3-4792-add3-db0c5d96377f None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:04.891713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08970035-0183-4324-bb38-a335cdab635c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:04.892469 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08970035-0183-4324-bb38-a335cdab635c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:04.892784 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08970035-0183-4324-bb38-a335cdab635c None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:04.893425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08970035-0183-4324-bb38-a335cdab635c None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:04.893896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08970035-0183-4324-bb38-a335cdab635c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:04.895549 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08970035-0183-4324-bb38-a335cdab635c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:04.904749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 285/561] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:04.905726 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08970035-0183-4324-bb38-a335cdab635c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:04.942626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a1430-38b1-4835-8936-dd44c4eaa788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:04.943207 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a1430-38b1-4835-8936-dd44c4eaa788 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:04.943583 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a1430-38b1-4835-8936-dd44c4eaa788 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:04.943845 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4a1430-38b1-4835-8936-dd44c4eaa788 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:04.944838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a1430-38b1-4835-8936-dd44c4eaa788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:04.945155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a1430-38b1-4835-8936-dd44c4eaa788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:04.947792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4a1430-38b1-4835-8936-dd44c4eaa788 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:04.951961 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:04.969418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 277/562] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:04.969418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a1430-38b1-4835-8936-dd44c4eaa788 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:04.991590 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:05.035007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08970035-0183-4324-bb38-a335cdab635c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.072706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e75d0-18ab-4523-a0b2-89def37fa8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:05.073331 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e75d0-18ab-4523-a0b2-89def37fa8da None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.073603 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e75d0-18ab-4523-a0b2-89def37fa8da None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.073868 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e75d0-18ab-4523-a0b2-89def37fa8da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.085550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e75d0-18ab-4523-a0b2-89def37fa8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:05.087096 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e75d0-18ab-4523-a0b2-89def37fa8da None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:05.096414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4a1430-38b1-4835-8936-dd44c4eaa788 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e11e75d0-18ab-4523-a0b2-89def37fa8da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:05.102314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:05.103397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:05.104317 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:05.104317 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:05.104317 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:05.104317 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 286/563] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:05.104617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e75d0-18ab-4523-a0b2-89def37fa8da None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:05.130979 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15a489-bdf5-4c54-9520-6944ddd50d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:05.131597 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a489-bdf5-4c54-9520-6944ddd50d5f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.131875 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a489-bdf5-4c54-9520-6944ddd50d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.132140 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a489-bdf5-4c54-9520-6944ddd50d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.142447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15a489-bdf5-4c54-9520-6944ddd50d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:05.143895 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d15a489-bdf5-4c54-9520-6944ddd50d5f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9d15a489-bdf5-4c54-9520-6944ddd50d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:05.158170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:05.159112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:05.159957 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:05.159957 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:05.159957 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:05.159957 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 278/564] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:05.160462 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610ebd0-f6c1-4442-a417-afd1e143e2a2 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.160730 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610ebd0-f6c1-4442-a417-afd1e143e2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.161005 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610ebd0-f6c1-4442-a417-afd1e143e2a2 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.162491 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 279/565] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:05.163193 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610ebd0-f6c1-4442-a417-afd1e143e2a2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:05.209042 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e75d0-18ab-4523-a0b2-89def37fa8da None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.214154 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:05.222327 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:05.243524 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26095a-a01a-4250-9173-d8cda7d9c520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:05.244143 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26095a-a01a-4250-9173-d8cda7d9c520 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.244423 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26095a-a01a-4250-9173-d8cda7d9c520 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.244694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26095a-a01a-4250-9173-d8cda7d9c520 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.252193 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26095a-a01a-4250-9173-d8cda7d9c520 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:05.253647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26095a-a01a-4250-9173-d8cda7d9c520 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-bd26095a-a01a-4250-9173-d8cda7d9c520 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:05.264721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:05.265842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:05.266802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:05.266802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:05.266802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:05.266802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:05.266802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:05.266802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:05.266802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:05.266802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:05.266802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:12:05.266802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:05.266802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 287/566] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:12:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:05.267686 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26095a-a01a-4250-9173-d8cda7d9c520 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:05.274538 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610ebd0-f6c1-4442-a417-afd1e143e2a2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.308672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee20c0e-d82c-4484-a388-4e46bdd6dbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:05.309297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20c0e-d82c-4484-a388-4e46bdd6dbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.309579 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20c0e-d82c-4484-a388-4e46bdd6dbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.309852 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee20c0e-d82c-4484-a388-4e46bdd6dbb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.320108 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee20c0e-d82c-4484-a388-4e46bdd6dbb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9ee20c0e-d82c-4484-a388-4e46bdd6dbb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:05.324750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:05.325742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 280/567] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:05.326596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee20c0e-d82c-4484-a388-4e46bdd6dbb8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:05.368988 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26095a-a01a-4250-9173-d8cda7d9c520 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.402586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cba6e3-cb92-4092-b08f-7aadf61ab5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:05.403175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cba6e3-cb92-4092-b08f-7aadf61ab5eb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.403456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cba6e3-cb92-4092-b08f-7aadf61ab5eb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.403725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cba6e3-cb92-4092-b08f-7aadf61ab5eb None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.404371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cba6e3-cb92-4092-b08f-7aadf61ab5eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:05.404672 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cba6e3-cb92-4092-b08f-7aadf61ab5eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:05.406029 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cba6e3-cb92-4092-b08f-7aadf61ab5eb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:05.418386 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 288/568] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:05.419540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ae045-9de8-4196-8f6e-cd60505f6649 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.419819 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ae045-9de8-4196-8f6e-cd60505f6649 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.420088 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ae045-9de8-4196-8f6e-cd60505f6649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.431647 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee20c0e-d82c-4484-a388-4e46bdd6dbb8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.437402 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a24ae045-9de8-4196-8f6e-cd60505f6649 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:05.438591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a24ae045-9de8-4196-8f6e-cd60505f6649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:05.441504 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:05.463895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:05.466581 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dda6c-3024-4bff-ac38-36480f929981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:05.467171 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dda6c-3024-4bff-ac38-36480f929981 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.467445 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dda6c-3024-4bff-ac38-36480f929981 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.467711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45dda6c-3024-4bff-ac38-36480f929981 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.468366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45dda6c-3024-4bff-ac38-36480f929981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:05.468662 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45dda6c-3024-4bff-ac38-36480f929981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:05.470012 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45dda6c-3024-4bff-ac38-36480f929981 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:05.481959 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 281/569] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:05.482780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dda6c-3024-4bff-ac38-36480f929981 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:05.511817 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 289/570] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:05.511817 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ae045-9de8-4196-8f6e-cd60505f6649 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:05.601024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45dda6c-3024-4bff-ac38-36480f929981 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.616725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ae045-9de8-4196-8f6e-cd60505f6649 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.636311 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020ae96-9fc3-4be8-9ecf-e0bd0a285c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:05.637288 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ae96-9fc3-4be8-9ecf-e0bd0a285c92 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.637670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ae96-9fc3-4be8-9ecf-e0bd0a285c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.638008 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020ae96-9fc3-4be8-9ecf-e0bd0a285c92 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.638822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020ae96-9fc3-4be8-9ecf-e0bd0a285c92 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:05.639127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020ae96-9fc3-4be8-9ecf-e0bd0a285c92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:05.640695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020ae96-9fc3-4be8-9ecf-e0bd0a285c92 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:05.652657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabb737-f6d8-4312-bf42-5b9a078fedde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:05.653258 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabb737-f6d8-4312-bf42-5b9a078fedde None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.653531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabb737-f6d8-4312-bf42-5b9a078fedde None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.653797 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabb737-f6d8-4312-bf42-5b9a078fedde None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.654477 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabb737-f6d8-4312-bf42-5b9a078fedde None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:05.654776 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabb737-f6d8-4312-bf42-5b9a078fedde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:05.656115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabb737-f6d8-4312-bf42-5b9a078fedde None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:05.662410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 282/571] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 07:12:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:05.663254 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020ae96-9fc3-4be8-9ecf-e0bd0a285c92 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:05.666422 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 290/572] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:05.667801 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabb737-f6d8-4312-bf42-5b9a078fedde None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:05.692520 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:05.695762 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:05.769172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020ae96-9fc3-4be8-9ecf-e0bd0a285c92 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.771633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabb737-f6d8-4312-bf42-5b9a078fedde None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.804134 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96beb8d-6c0a-4063-91c8-daa650965c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:05.804760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96beb8d-6c0a-4063-91c8-daa650965c08 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.805041 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96beb8d-6c0a-4063-91c8-daa650965c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.805310 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96beb8d-6c0a-4063-91c8-daa650965c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.805878 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96663a2-2a4f-4946-ba4d-5d3e9cf1f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:05.806521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96663a2-2a4f-4946-ba4d-5d3e9cf1f656 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.806795 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96663a2-2a4f-4946-ba4d-5d3e9cf1f656 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.807060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96663a2-2a4f-4946-ba4d-5d3e9cf1f656 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.812257 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96beb8d-6c0a-4063-91c8-daa650965c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:05.813696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96beb8d-6c0a-4063-91c8-daa650965c08 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:05.814005 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96663a2-2a4f-4946-ba4d-5d3e9cf1f656 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:05.815739 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96663a2-2a4f-4946-ba4d-5d3e9cf1f656 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e96beb8d-6c0a-4063-91c8-daa650965c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:05.825078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:05.825991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:05.826883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:05.826883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:05.826883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:05.826883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:05.826883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:05.826883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:05.826883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:05.826883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:05.826883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 283/573] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b96663a2-2a4f-4946-ba4d-5d3e9cf1f656 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:05.827354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:05.828167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:05.829974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:05.829974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:05.829974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:05.829974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:05.829974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:05.829974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:05.829974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:05.829974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:05.829974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:12:05.829974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:05.830777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96beb8d-6c0a-4063-91c8-daa650965c08 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:05.830866 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 291/574] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 07:12:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:05.830866 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96663a2-2a4f-4946-ba4d-5d3e9cf1f656 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:05.914933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:05.915567 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:05.930757 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96beb8d-6c0a-4063-91c8-daa650965c08 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.931436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96663a2-2a4f-4946-ba4d-5d3e9cf1f656 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:05.963261 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15e807-93f7-4ee6-8b00-ca919c4a5637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:05.963862 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e807-93f7-4ee6-8b00-ca919c4a5637 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:05.964137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e807-93f7-4ee6-8b00-ca919c4a5637 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:05.964402 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e807-93f7-4ee6-8b00-ca919c4a5637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:05.974770 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15e807-93f7-4ee6-8b00-ca919c4a5637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:05.976485 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15e807-93f7-4ee6-8b00-ca919c4a5637 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6d15e807-93f7-4ee6-8b00-ca919c4a5637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:05.991596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:05.992720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:05.993802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:05.993802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:05.993802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:05.997154 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 292/575] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:05.997953 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15e807-93f7-4ee6-8b00-ca919c4a5637 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.007943 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095cd28-ca01-46b9-adbc-806b8f8856f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.008569 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095cd28-ca01-46b9-adbc-806b8f8856f8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.008845 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095cd28-ca01-46b9-adbc-806b8f8856f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.009118 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095cd28-ca01-46b9-adbc-806b8f8856f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.019719 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095cd28-ca01-46b9-adbc-806b8f8856f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:06.021097 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095cd28-ca01-46b9-adbc-806b8f8856f8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-4095cd28-ca01-46b9-adbc-806b8f8856f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:06.035634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:06.036563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:06.037437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:06.037437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:06.037437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:06.037437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 284/576] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:06.037437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095cd28-ca01-46b9-adbc-806b8f8856f8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.102089 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15e807-93f7-4ee6-8b00-ca919c4a5637 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.134511 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a0f42-9c17-4e11-86e6-5608be4d58db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.135124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a0f42-9c17-4e11-86e6-5608be4d58db None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.135228 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095cd28-ca01-46b9-adbc-806b8f8856f8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.135669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a0f42-9c17-4e11-86e6-5608be4d58db None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.135669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a0f42-9c17-4e11-86e6-5608be4d58db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.138271 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:06.147165 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7a0f42-9c17-4e11-86e6-5608be4d58db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1a7a0f42-9c17-4e11-86e6-5608be4d58db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:06.151757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:06.153221 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 293/577] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:06.154468 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a0f42-9c17-4e11-86e6-5608be4d58db None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.171976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214bcaa-19c1-4fb6-8fc5-cd34b83c2e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.172809 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214bcaa-19c1-4fb6-8fc5-cd34b83c2e2b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.173100 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214bcaa-19c1-4fb6-8fc5-cd34b83c2e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.173499 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214bcaa-19c1-4fb6-8fc5-cd34b83c2e2b None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.174482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214bcaa-19c1-4fb6-8fc5-cd34b83c2e2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:06.174786 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214bcaa-19c1-4fb6-8fc5-cd34b83c2e2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:06.176201 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214bcaa-19c1-4fb6-8fc5-cd34b83c2e2b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:06.183968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:06.189497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 285/578] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:06.190309 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214bcaa-19c1-4fb6-8fc5-cd34b83c2e2b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.251492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a0f42-9c17-4e11-86e6-5608be4d58db None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.285069 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a61fa-8591-4b27-a375-3f2dbe7cff4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.285587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a61fa-8591-4b27-a375-3f2dbe7cff4d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.285866 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a61fa-8591-4b27-a375-3f2dbe7cff4d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.286164 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a61fa-8591-4b27-a375-3f2dbe7cff4d None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.286885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a61fa-8591-4b27-a375-3f2dbe7cff4d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:06.287189 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a61fa-8591-4b27-a375-3f2dbe7cff4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:06.288626 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a61fa-8591-4b27-a375-3f2dbe7cff4d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:06.291620 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214bcaa-19c1-4fb6-8fc5-cd34b83c2e2b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.305233 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 294/579] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:06.306029 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a61fa-8591-4b27-a375-3f2dbe7cff4d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.324761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54e63a-98a4-49ad-81f3-ed1f67a349cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.325364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e63a-98a4-49ad-81f3-ed1f67a349cd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.325641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e63a-98a4-49ad-81f3-ed1f67a349cd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.325912 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54e63a-98a4-49ad-81f3-ed1f67a349cd None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.326580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54e63a-98a4-49ad-81f3-ed1f67a349cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:06.326878 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54e63a-98a4-49ad-81f3-ed1f67a349cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:06.328234 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54e63a-98a4-49ad-81f3-ed1f67a349cd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:06.344269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 286/580] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:06.344269 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54e63a-98a4-49ad-81f3-ed1f67a349cd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.362077 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:06.398872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:06.405761 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a61fa-8591-4b27-a375-3f2dbe7cff4d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.438558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56a80-2f6a-435c-9822-137b53927c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.439842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56a80-2f6a-435c-9822-137b53927c4c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.440121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56a80-2f6a-435c-9822-137b53927c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.440392 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56a80-2f6a-435c-9822-137b53927c4c None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.441040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56a80-2f6a-435c-9822-137b53927c4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:06.441339 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56a80-2f6a-435c-9822-137b53927c4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:06.442488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54e63a-98a4-49ad-81f3-ed1f67a349cd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.442749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56a80-2f6a-435c-9822-137b53927c4c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:06.455494 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 295/581] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:06.456284 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56a80-2f6a-435c-9822-137b53927c4c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.480871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38350b5-6584-4819-823e-f6d123f3f881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.481469 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38350b5-6584-4819-823e-f6d123f3f881 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.481740 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38350b5-6584-4819-823e-f6d123f3f881 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.482008 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38350b5-6584-4819-823e-f6d123f3f881 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.482687 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38350b5-6584-4819-823e-f6d123f3f881 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:06.482981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38350b5-6584-4819-823e-f6d123f3f881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:06.484355 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38350b5-6584-4819-823e-f6d123f3f881 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:06.492885 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 287/582] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:06.493499 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38350b5-6584-4819-823e-f6d123f3f881 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.555457 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56a80-2f6a-435c-9822-137b53927c4c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.569301 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:06.590013 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c0284-c6d1-411e-9161-394f140d15ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.590644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0284-c6d1-411e-9161-394f140d15ff None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.591202 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0284-c6d1-411e-9161-394f140d15ff None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.591499 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c0284-c6d1-411e-9161-394f140d15ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.592260 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c0284-c6d1-411e-9161-394f140d15ff None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=b115a3ce93804ddbaf542934addb506b) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:06.592550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38350b5-6584-4819-823e-f6d123f3f881 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.592654 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c0284-c6d1-411e-9161-394f140d15ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:06.594061 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c0284-c6d1-411e-9161-394f140d15ff None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:06.600033 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 296/583] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/role_assignments?user.id=b115a3ce93804ddbaf542934addb506b&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:06.600806 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c0284-c6d1-411e-9161-394f140d15ff None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.619881 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:06.637878 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedac85a-9bfa-4fac-91d5-a7bc6bc4cdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.638724 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac85a-9bfa-4fac-91d5-a7bc6bc4cdea None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.638897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac85a-9bfa-4fac-91d5-a7bc6bc4cdea None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.639131 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedac85a-9bfa-4fac-91d5-a7bc6bc4cdea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.653189 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedac85a-9bfa-4fac-91d5-a7bc6bc4cdea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:06.654711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedac85a-9bfa-4fac-91d5-a7bc6bc4cdea None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-fedac85a-9bfa-4fac-91d5-a7bc6bc4cdea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:06.670416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:06.671449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:06.672371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:06.672371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:06.672371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:06.672371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 288/584] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:06.672592 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedac85a-9bfa-4fac-91d5-a7bc6bc4cdea None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.723350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c0284-c6d1-411e-9161-394f140d15ff None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.759988 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58aa0b-f626-494a-9248-02153e759b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.760630 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58aa0b-f626-494a-9248-02153e759b8a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.761045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58aa0b-f626-494a-9248-02153e759b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.761282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58aa0b-f626-494a-9248-02153e759b8a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.770132 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58aa0b-f626-494a-9248-02153e759b8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:06.771675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58aa0b-f626-494a-9248-02153e759b8a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:06.782981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedac85a-9bfa-4fac-91d5-a7bc6bc4cdea None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ff58aa0b-f626-494a-9248-02153e759b8a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:06.784671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:06.785557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 297/585] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:06.787199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58aa0b-f626-494a-9248-02153e759b8a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.824641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46560064-0b20-4680-8715-ce473d37ab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.825202 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46560064-0b20-4680-8715-ce473d37ab2b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.825525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46560064-0b20-4680-8715-ce473d37ab2b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.825796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46560064-0b20-4680-8715-ce473d37ab2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.828853 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:06.833953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46560064-0b20-4680-8715-ce473d37ab2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:06.835452 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46560064-0b20-4680-8715-ce473d37ab2b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-46560064-0b20-4680-8715-ce473d37ab2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:06.847867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:06.848854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:06.849758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:06.849758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:06.849758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:06.849758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:06.849758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:06.849758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:06.849758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:06.849758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:06.853641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 289/586] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:06.854547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46560064-0b20-4680-8715-ce473d37ab2b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:06.890068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:06.900779 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58aa0b-f626-494a-9248-02153e759b8a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.938842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eebeba-5d07-4ee9-9369-b0273fc2a57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:06.939581 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebeba-5d07-4ee9-9369-b0273fc2a57b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:06.939829 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebeba-5d07-4ee9-9369-b0273fc2a57b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:06.940014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebeba-5d07-4ee9-9369-b0273fc2a57b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:06.950648 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eebeba-5d07-4ee9-9369-b0273fc2a57b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:06.952584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eebeba-5d07-4ee9-9369-b0273fc2a57b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:06.967848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46560064-0b20-4680-8715-ce473d37ab2b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d9eebeba-5d07-4ee9-9369-b0273fc2a57b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:06.968828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:06.969759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:06.971641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:06.971641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:06.971641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:06.971641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 298/587] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:06.971641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eebeba-5d07-4ee9-9369-b0273fc2a57b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:07.011633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264f93-58b9-460f-9125-5727cd21deb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:07.012407 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264f93-58b9-460f-9125-5727cd21deb0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:07.013141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264f93-58b9-460f-9125-5727cd21deb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:07.013431 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264f93-58b9-460f-9125-5727cd21deb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:07.014080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af264f93-58b9-460f-9125-5727cd21deb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:07.014411 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af264f93-58b9-460f-9125-5727cd21deb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:07.016460 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af264f93-58b9-460f-9125-5727cd21deb0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:07.029052 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 290/588] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:07.029983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264f93-58b9-460f-9125-5727cd21deb0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:07.071054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:07.081479 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eebeba-5d07-4ee9-9369-b0273fc2a57b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:07.118730 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a9d9b-c475-4c87-82b7-462541b46f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:07.119311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a9d9b-c475-4c87-82b7-462541b46f17 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:07.119593 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a9d9b-c475-4c87-82b7-462541b46f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:07.119867 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a9d9b-c475-4c87-82b7-462541b46f17 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:07.120716 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a9d9b-c475-4c87-82b7-462541b46f17 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:07.121021 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a9d9b-c475-4c87-82b7-462541b46f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:07.122470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a9d9b-c475-4c87-82b7-462541b46f17 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:07.124247 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:07.132533 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264f93-58b9-460f-9125-5727cd21deb0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:07.146082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 299/589] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 07:12:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:07.146082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a9d9b-c475-4c87-82b7-462541b46f17 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:07.173068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723e4e0-0f9b-4071-9fb4-ce5b307c7850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:07.173921 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723e4e0-0f9b-4071-9fb4-ce5b307c7850 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:07.174255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723e4e0-0f9b-4071-9fb4-ce5b307c7850 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:07.174509 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723e4e0-0f9b-4071-9fb4-ce5b307c7850 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:07.175223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723e4e0-0f9b-4071-9fb4-ce5b307c7850 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:07.175593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723e4e0-0f9b-4071-9fb4-ce5b307c7850 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:07.177109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6723e4e0-0f9b-4071-9fb4-ce5b307c7850 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:07.190297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 291/590] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:07.190794 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723e4e0-0f9b-4071-9fb4-ce5b307c7850 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:07.264589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a9d9b-c475-4c87-82b7-462541b46f17 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:07.295933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6723e4e0-0f9b-4071-9fb4-ce5b307c7850 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:07.299596 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1faa5a-441d-4ad2-91ec-f69adc695687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:07.300187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1faa5a-441d-4ad2-91ec-f69adc695687 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:07.300464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1faa5a-441d-4ad2-91ec-f69adc695687 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:07.300732 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1faa5a-441d-4ad2-91ec-f69adc695687 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:07.301365 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1faa5a-441d-4ad2-91ec-f69adc695687 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:07.301661 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1faa5a-441d-4ad2-91ec-f69adc695687 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:07.303051 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1faa5a-441d-4ad2-91ec-f69adc695687 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:07.315353 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 300/591] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:07.316139 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1faa5a-441d-4ad2-91ec-f69adc695687 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:07.329374 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:07.335549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78f223-7bed-40e5-a5da-0bb6ef6c6db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:07.336112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78f223-7bed-40e5-a5da-0bb6ef6c6db2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:07.336389 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78f223-7bed-40e5-a5da-0bb6ef6c6db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:07.336658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d78f223-7bed-40e5-a5da-0bb6ef6c6db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:07.343664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78f223-7bed-40e5-a5da-0bb6ef6c6db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:07.345141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d78f223-7bed-40e5-a5da-0bb6ef6c6db2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-7d78f223-7bed-40e5-a5da-0bb6ef6c6db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:07.356065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:07.361103 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:07.361951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:07.361951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:07.361951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:07.361951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:07.361951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:07.361951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:07.361951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:07.361951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:07.361951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 292/592] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:07.361951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78f223-7bed-40e5-a5da-0bb6ef6c6db2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:07.379749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:07.425535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1faa5a-441d-4ad2-91ec-f69adc695687 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:07.462641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd4ab5-64c7-449a-9ee7-64b4eea9ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:07.463264 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd4ab5-64c7-449a-9ee7-64b4eea9ded6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:07.463542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd4ab5-64c7-449a-9ee7-64b4eea9ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:07.463817 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd4ab5-64c7-449a-9ee7-64b4eea9ded6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:07.470331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d78f223-7bed-40e5-a5da-0bb6ef6c6db2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:07.475219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd4ab5-64c7-449a-9ee7-64b4eea9ded6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:07.476658 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cd4ab5-64c7-449a-9ee7-64b4eea9ded6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b4cd4ab5-64c7-449a-9ee7-64b4eea9ded6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:07.490767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:07.491738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:07.493282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:07.493282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:07.493282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:07.493282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 301/593] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:07.493282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd4ab5-64c7-449a-9ee7-64b4eea9ded6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:07.510717 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635e412-49e2-48bd-9e04-385bbce908f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:07.511384 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e412-49e2-48bd-9e04-385bbce908f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:07.511665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e412-49e2-48bd-9e04-385bbce908f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:07.511933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635e412-49e2-48bd-9e04-385bbce908f6 None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/790353a3d5d543bca467802f1d9fd6fb/roles/66779f51859f47aa886ee36ac8501a65` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:07.527524 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635e412-49e2-48bd-9e04-385bbce908f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=790353a3d5d543bca467802f1d9fd6fb, role_id=66779f51859f47aa886ee36ac8501a65)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:07.528984 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635e412-49e2-48bd-9e04-385bbce908f6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:07.558932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:07.598934 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 293/594] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:12:07 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/790353a3d5d543bca467802f1d9fd6fb/roles/66779f51859f47aa886ee36ac8501a65 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:12:07.599701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635e412-49e2-48bd-9e04-385bbce908f6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:07.611306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cd4ab5-64c7-449a-9ee7-64b4eea9ded6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:07.651896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67e78a-8a21-4ec7-a3eb-bcaade68c5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:07.652937 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67e78a-8a21-4ec7-a3eb-bcaade68c5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:07.653424 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67e78a-8a21-4ec7-a3eb-bcaade68c5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:07.653842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67e78a-8a21-4ec7-a3eb-bcaade68c5c1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:07.664499 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67e78a-8a21-4ec7-a3eb-bcaade68c5c1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:07.666645 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67e78a-8a21-4ec7-a3eb-bcaade68c5c1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:07.676333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8b67e78a-8a21-4ec7-a3eb-bcaade68c5c1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:07.681345 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:07.687306 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 302/595] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:07.688786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67e78a-8a21-4ec7-a3eb-bcaade68c5c1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:07.727953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635e412-49e2-48bd-9e04-385bbce908f6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:07.766413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bcd01-fe28-4aaa-9569-fd02f0bea9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:07.767730 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bcd01-fe28-4aaa-9569-fd02f0bea9cc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:07.768010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bcd01-fe28-4aaa-9569-fd02f0bea9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:07.768433 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bcd01-fe28-4aaa-9569-fd02f0bea9cc None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:07.769142 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bcd01-fe28-4aaa-9569-fd02f0bea9cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:07.769446 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bcd01-fe28-4aaa-9569-fd02f0bea9cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:07.771014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bcd01-fe28-4aaa-9569-fd02f0bea9cc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:07.785538 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 294/596] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:07.786412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bcd01-fe28-4aaa-9569-fd02f0bea9cc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:07.807561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67e78a-8a21-4ec7-a3eb-bcaade68c5c1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:07.831842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:07.845114 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8e9ae-cc37-4ce3-85ee-197f773756d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:07.845919 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e9ae-cc37-4ce3-85ee-197f773756d7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:07.846233 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e9ae-cc37-4ce3-85ee-197f773756d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:07.846509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8e9ae-cc37-4ce3-85ee-197f773756d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:07.847168 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8e9ae-cc37-4ce3-85ee-197f773756d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:07.854231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8e9ae-cc37-4ce3-85ee-197f773756d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:07.854231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b8e9ae-cc37-4ce3-85ee-197f773756d7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:07.863448 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 303/597] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:07.864527 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8e9ae-cc37-4ce3-85ee-197f773756d7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:07.916755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bcd01-fe28-4aaa-9569-fd02f0bea9cc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:07.947543 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:07.962469 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784458f1-64cb-4c83-bb20-0f9bc6a04d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:07.963191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784458f1-64cb-4c83-bb20-0f9bc6a04d3b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:07.963696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784458f1-64cb-4c83-bb20-0f9bc6a04d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:07.964028 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784458f1-64cb-4c83-bb20-0f9bc6a04d3b None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:07.965143 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784458f1-64cb-4c83-bb20-0f9bc6a04d3b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:07.965917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784458f1-64cb-4c83-bb20-0f9bc6a04d3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:07.967909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784458f1-64cb-4c83-bb20-0f9bc6a04d3b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:07.974825 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8e9ae-cc37-4ce3-85ee-197f773756d7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:07.995905 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 295/598] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 23 07:12:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:07.997017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784458f1-64cb-4c83-bb20-0f9bc6a04d3b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:08.018539 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418f602-c1df-4524-bdf8-bfc75f51cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:08.019414 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418f602-c1df-4524-bdf8-bfc75f51cdcd None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:08.019781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418f602-c1df-4524-bdf8-bfc75f51cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:08.020174 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5418f602-c1df-4524-bdf8-bfc75f51cdcd None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/bb99f54d9320496cbcc52d535fa64789/roles/66779f51859f47aa886ee36ac8501a65` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:08.039983 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418f602-c1df-4524-bdf8-bfc75f51cdcd None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=bb99f54d9320496cbcc52d535fa64789, role_id=66779f51859f47aa886ee36ac8501a65)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:08.042027 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5418f602-c1df-4524-bdf8-bfc75f51cdcd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:08.103722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784458f1-64cb-4c83-bb20-0f9bc6a04d3b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:08.126970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 304/599] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:12:07 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/bb99f54d9320496cbcc52d535fa64789/roles/66779f51859f47aa886ee36ac8501a65 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:12:08.126970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418f602-c1df-4524-bdf8-bfc75f51cdcd None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:08.161806 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbb8bc-876c-4250-988d-d4b2efbbc068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:08.162557 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbb8bc-876c-4250-988d-d4b2efbbc068 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:08.162905 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbb8bc-876c-4250-988d-d4b2efbbc068 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:08.163183 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbb8bc-876c-4250-988d-d4b2efbbc068 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:08.173936 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbb8bc-876c-4250-988d-d4b2efbbc068 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:08.175649 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbb8bc-876c-4250-988d-d4b2efbbc068 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-64dbb8bc-876c-4250-988d-d4b2efbbc068 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:08.188322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:08.189948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:08.191540 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:08.191540 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:08.191540 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:08.191540 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:08.191540 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:08.191540 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:08.191540 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:08.191540 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:08.191540 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 296/600] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:08.196059 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbb8bc-876c-4250-988d-d4b2efbbc068 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:08.198420 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:08.248691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:08.316626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbb8bc-876c-4250-988d-d4b2efbbc068 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:08.322460 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5418f602-c1df-4524-bdf8-bfc75f51cdcd None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:08.358879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e1f6c-8abc-4d9d-8fc9-02e118c1a682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:08.359662 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e1f6c-8abc-4d9d-8fc9-02e118c1a682 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:08.360033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e1f6c-8abc-4d9d-8fc9-02e118c1a682 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:08.360957 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e1f6c-8abc-4d9d-8fc9-02e118c1a682 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:08.361956 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e1f6c-8abc-4d9d-8fc9-02e118c1a682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:08.362396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e1f6c-8abc-4d9d-8fc9-02e118c1a682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:08.364074 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e1f6c-8abc-4d9d-8fc9-02e118c1a682 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:08.368920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc398b8-b34f-4ea3-bb67-69ac57b6b530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:08.369725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc398b8-b34f-4ea3-bb67-69ac57b6b530 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:08.370175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc398b8-b34f-4ea3-bb67-69ac57b6b530 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:08.370587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc398b8-b34f-4ea3-bb67-69ac57b6b530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:08.378023 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 297/601] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:08.388177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e1f6c-8abc-4d9d-8fc9-02e118c1a682 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:08.389593 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc398b8-b34f-4ea3-bb67-69ac57b6b530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:08.393481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc398b8-b34f-4ea3-bb67-69ac57b6b530 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-efc398b8-b34f-4ea3-bb67-69ac57b6b530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:08.418023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:08.419049 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:08.420273 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:08.420273 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:08.420273 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:08.420273 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 305/602] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:08.428139 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc398b8-b34f-4ea3-bb67-69ac57b6b530 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:08.562935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e1f6c-8abc-4d9d-8fc9-02e118c1a682 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:08.566308 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:08.598146 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:08.609944 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc398b8-b34f-4ea3-bb67-69ac57b6b530 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:08.630525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d62e8-5f31-4f42-95f7-edf84c1b5a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:08.630525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d62e8-5f31-4f42-95f7-edf84c1b5a52 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:08.630525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d62e8-5f31-4f42-95f7-edf84c1b5a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:08.630525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d62e8-5f31-4f42-95f7-edf84c1b5a52 None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/a59542e893d244ca9a268fc388052329/roles/66779f51859f47aa886ee36ac8501a65` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:08.655879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d62e8-5f31-4f42-95f7-edf84c1b5a52 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=a59542e893d244ca9a268fc388052329, role_id=66779f51859f47aa886ee36ac8501a65)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:08.657412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d62e8-5f31-4f42-95f7-edf84c1b5a52 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:08.669145 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300d24d-d185-44cd-a79b-c7d962d5c2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:08.669857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d24d-d185-44cd-a79b-c7d962d5c2cc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:08.670693 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d24d-d185-44cd-a79b-c7d962d5c2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:08.670693 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d24d-d185-44cd-a79b-c7d962d5c2cc None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:08.671257 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300d24d-d185-44cd-a79b-c7d962d5c2cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:08.671623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300d24d-d185-44cd-a79b-c7d962d5c2cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:08.673645 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8300d24d-d185-44cd-a79b-c7d962d5c2cc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:08.685635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 306/603] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:08.689716 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8ae0-ab15-48c6-b7dc-69d0163833b7 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:08.689716 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8ae0-ab15-48c6-b7dc-69d0163833b7 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:08.689716 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b8ae0-ab15-48c6-b7dc-69d0163833b7 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:08.693514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 307/604] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:08.694366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b8ae0-ab15-48c6-b7dc-69d0163833b7 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:08.738607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 298/605] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:12:08 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/a59542e893d244ca9a268fc388052329/roles/66779f51859f47aa886ee36ac8501a65 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:12:08.744403 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5a517-da79-47d8-9dd2-566a422a19b1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:08.744403 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5a517-da79-47d8-9dd2-566a422a19b1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:08.744403 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5a517-da79-47d8-9dd2-566a422a19b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:08.780373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-f8e5a517-da79-47d8-9dd2-566a422a19b1 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:08.784609 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-f8e5a517-da79-47d8-9dd2-566a422a19b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:08.872582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b8ae0-ab15-48c6-b7dc-69d0163833b7 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:08.931464 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 299/606] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:08.936727 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999de8e-151c-4b8b-8a43-f25efbd8ec7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:08.937618 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999de8e-151c-4b8b-8a43-f25efbd8ec7f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:08.938113 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999de8e-151c-4b8b-8a43-f25efbd8ec7f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:08.939071 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999de8e-151c-4b8b-8a43-f25efbd8ec7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:08.947555 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999de8e-151c-4b8b-8a43-f25efbd8ec7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:08.949233 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999de8e-151c-4b8b-8a43-f25efbd8ec7f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a999de8e-151c-4b8b-8a43-f25efbd8ec7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:08.963072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:08.964197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:08.965090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:08.965090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:08.965090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:08.965090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:08.965090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:08.965090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:08.965090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:08.965090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:08.967700 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 308/607] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:08.973846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5a517-da79-47d8-9dd2-566a422a19b1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:09.065609 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:09.085958 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5a517-da79-47d8-9dd2-566a422a19b1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:09.123050 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56272c-5f3d-4466-a1f6-debd2f972501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:09.123786 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56272c-5f3d-4466-a1f6-debd2f972501 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:09.124125 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56272c-5f3d-4466-a1f6-debd2f972501 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:09.124447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56272c-5f3d-4466-a1f6-debd2f972501 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:09.125253 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56272c-5f3d-4466-a1f6-debd2f972501 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:09.125618 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56272c-5f3d-4466-a1f6-debd2f972501 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:09.128289 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56272c-5f3d-4466-a1f6-debd2f972501 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:09.140848 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 300/608] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:09.147492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999de8e-151c-4b8b-8a43-f25efbd8ec7f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:09.150551 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:09.237202 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56272c-5f3d-4466-a1f6-debd2f972501 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:09.269056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999de8e-151c-4b8b-8a43-f25efbd8ec7f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:09.319109 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbff4a9-6bbc-4ecd-9b4d-f91e84b47258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:09.319925 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff4a9-6bbc-4ecd-9b4d-f91e84b47258 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:09.320297 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff4a9-6bbc-4ecd-9b4d-f91e84b47258 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:09.320664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbff4a9-6bbc-4ecd-9b4d-f91e84b47258 None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/e952426a4d6949b3bd9ee5923abd637f/roles/66779f51859f47aa886ee36ac8501a65` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:09.337773 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbff4a9-6bbc-4ecd-9b4d-f91e84b47258 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=e952426a4d6949b3bd9ee5923abd637f, role_id=66779f51859f47aa886ee36ac8501a65)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:09.339416 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbff4a9-6bbc-4ecd-9b4d-f91e84b47258 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:09.359590 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56272c-5f3d-4466-a1f6-debd2f972501 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:09.396672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573402a-14a8-43fc-86ae-f69750062e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:09.397484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573402a-14a8-43fc-86ae-f69750062e4f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:09.397908 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573402a-14a8-43fc-86ae-f69750062e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:09.398304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573402a-14a8-43fc-86ae-f69750062e4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:09.406847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:09.411619 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573402a-14a8-43fc-86ae-f69750062e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:09.421463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 309/609] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:12:09 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/e952426a4d6949b3bd9ee5923abd637f/roles/66779f51859f47aa886ee36ac8501a65 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f573402a-14a8-43fc-86ae-f69750062e4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:09.424695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:09.425909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:09.427016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:09.434168 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 301/610] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:09.434797 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbff4a9-6bbc-4ecd-9b4d-f91e84b47258 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:09.555522 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:09.617559 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbff4a9-6bbc-4ecd-9b4d-f91e84b47258 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:09.654458 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf5305-aa44-45f8-833c-67c1fbe34583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:09.655324 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5305-aa44-45f8-833c-67c1fbe34583 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:09.655746 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5305-aa44-45f8-833c-67c1fbe34583 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:09.656158 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5305-aa44-45f8-833c-67c1fbe34583 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:09.656977 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf5305-aa44-45f8-833c-67c1fbe34583 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:09.657997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf5305-aa44-45f8-833c-67c1fbe34583 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:09.659536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf5305-aa44-45f8-833c-67c1fbe34583 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:09.670295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 310/611] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:09.676231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573402a-14a8-43fc-86ae-f69750062e4f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:09.767753 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f16087-97f0-41e8-8c74-c8af6a6725e8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:09.768053 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f16087-97f0-41e8-8c74-c8af6a6725e8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:09.768483 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f16087-97f0-41e8-8c74-c8af6a6725e8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:09.773894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 311/612] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:12:09.775214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd63902-90d9-4c02-b9bf-90da7ef87e25 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:09.775573 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd63902-90d9-4c02-b9bf-90da7ef87e25 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:09.775918 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd63902-90d9-4c02-b9bf-90da7ef87e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:09.795984 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7bd63902-90d9-4c02-b9bf-90da7ef87e25 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:09.798663 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7bd63902-90d9-4c02-b9bf-90da7ef87e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:09.806699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573402a-14a8-43fc-86ae-f69750062e4f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:09.865969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b6f0-3ded-497a-84d4-0c4d7fbd12e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:09.866654 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b6f0-3ded-497a-84d4-0c4d7fbd12e3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:09.866930 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b6f0-3ded-497a-84d4-0c4d7fbd12e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:09.867200 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16b6f0-3ded-497a-84d4-0c4d7fbd12e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:09.887673 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16b6f0-3ded-497a-84d4-0c4d7fbd12e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:09.889126 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16b6f0-3ded-497a-84d4-0c4d7fbd12e3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ab16b6f0-3ded-497a-84d4-0c4d7fbd12e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:09.912660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:09.913629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:09.914958 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:09.914958 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:09.914958 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:09.914958 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 302/613] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:09.922749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b6f0-3ded-497a-84d4-0c4d7fbd12e3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:09.927552 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 312/614] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:12:09.989806 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:10.046318 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16b6f0-3ded-497a-84d4-0c4d7fbd12e3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:10.081845 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40774b18-43b3-4f1b-8af4-5cff8f621b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:10.082404 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40774b18-43b3-4f1b-8af4-5cff8f621b1a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:10.082679 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40774b18-43b3-4f1b-8af4-5cff8f621b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:10.082946 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40774b18-43b3-4f1b-8af4-5cff8f621b1a None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:10.083588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40774b18-43b3-4f1b-8af4-5cff8f621b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:10.083887 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40774b18-43b3-4f1b-8af4-5cff8f621b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:10.085235 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40774b18-43b3-4f1b-8af4-5cff8f621b1a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:10.098941 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 303/615] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:10.107226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd63902-90d9-4c02-b9bf-90da7ef87e25 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:10.186253 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:10.259981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd63902-90d9-4c02-b9bf-90da7ef87e25 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:10.309397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d77eb6-e720-4a23-9866-3bb52b5d28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:10.310052 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d77eb6-e720-4a23-9866-3bb52b5d28d2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:10.310361 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d77eb6-e720-4a23-9866-3bb52b5d28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:10.310630 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d77eb6-e720-4a23-9866-3bb52b5d28d2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:10.324669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d77eb6-e720-4a23-9866-3bb52b5d28d2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:10.326147 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d77eb6-e720-4a23-9866-3bb52b5d28d2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-93d77eb6-e720-4a23-9866-3bb52b5d28d2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:10.338488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:10.339387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:10.341183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:10.341183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:10.341183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:10.341183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:10.341183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:10.341183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:10.341183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:10.341183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:10.341183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:10.341183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:10.341183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 313/616] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:10.345521 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40774b18-43b3-4f1b-8af4-5cff8f621b1a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:10.369369 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d77eb6-e720-4a23-9866-3bb52b5d28d2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:10.505601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40774b18-43b3-4f1b-8af4-5cff8f621b1a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:10.520665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:10.542825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63c85d-cbbd-431d-84d2-6fbbb8853eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:10.543451 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c85d-cbbd-431d-84d2-6fbbb8853eee None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:10.543730 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c85d-cbbd-431d-84d2-6fbbb8853eee None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:10.544002 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63c85d-cbbd-431d-84d2-6fbbb8853eee None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:10.548546 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63c85d-cbbd-431d-84d2-6fbbb8853eee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:10.548546 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63c85d-cbbd-431d-84d2-6fbbb8853eee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:10.548546 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63c85d-cbbd-431d-84d2-6fbbb8853eee None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:10.567170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 304/617] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 07:12:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:10.574460 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63c85d-cbbd-431d-84d2-6fbbb8853eee None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:10.590066 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d77eb6-e720-4a23-9866-3bb52b5d28d2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:10.608767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:10.644767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120d9f1-df13-45e9-aae9-22c941b3d325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:10.645385 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120d9f1-df13-45e9-aae9-22c941b3d325 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:10.645661 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120d9f1-df13-45e9-aae9-22c941b3d325 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:10.645930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120d9f1-df13-45e9-aae9-22c941b3d325 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:10.656427 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120d9f1-df13-45e9-aae9-22c941b3d325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8120d9f1-df13-45e9-aae9-22c941b3d325 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:10.662184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:10.663150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:10.664377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 314/618] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:10.665455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf7b6-d742-4a91-a139-667f2503c8a3 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:10.665455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf7b6-d742-4a91-a139-667f2503c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:10.665455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaf7b6-d742-4a91-a139-667f2503c8a3 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:10.666873 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 315/619] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:10.669017 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaf7b6-d742-4a91-a139-667f2503c8a3 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:10.726224 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63c85d-cbbd-431d-84d2-6fbbb8853eee None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:10.761788 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9536ff9-1fd8-4dd3-8036-61631c8f359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:10.762463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536ff9-1fd8-4dd3-8036-61631c8f359e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:10.762743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536ff9-1fd8-4dd3-8036-61631c8f359e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:10.763012 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536ff9-1fd8-4dd3-8036-61631c8f359e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:10.775220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9536ff9-1fd8-4dd3-8036-61631c8f359e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:10.776674 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9536ff9-1fd8-4dd3-8036-61631c8f359e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:10.781756 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaf7b6-d742-4a91-a139-667f2503c8a3 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e9536ff9-1fd8-4dd3-8036-61631c8f359e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:10.792927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:10.794851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:10.796871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:10.796871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:10.796871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:10.799924 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 305/620] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:10.801580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70311380-48e6-4a71-bab2-ed04d32ee83b None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:10.801580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70311380-48e6-4a71-bab2-ed04d32ee83b None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:10.801580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70311380-48e6-4a71-bab2-ed04d32ee83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:10.821861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-70311380-48e6-4a71-bab2-ed04d32ee83b None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:10.822573 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bdac6-2410-4c00-98ac-3341e6cf81ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:10.823128 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-70311380-48e6-4a71-bab2-ed04d32ee83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:10.823381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdac6-2410-4c00-98ac-3341e6cf81ca None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:10.823757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdac6-2410-4c00-98ac-3341e6cf81ca None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:10.824160 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4bdac6-2410-4c00-98ac-3341e6cf81ca None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:10.824924 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bdac6-2410-4c00-98ac-3341e6cf81ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:10.825339 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bdac6-2410-4c00-98ac-3341e6cf81ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:10.826915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4bdac6-2410-4c00-98ac-3341e6cf81ca None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:10.836322 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 316/621] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:10.837244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bdac6-2410-4c00-98ac-3341e6cf81ca None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:10.846822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:10.867041 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:10.904058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 306/622] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:10.905194 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70311380-48e6-4a71-bab2-ed04d32ee83b None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:10.966387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4bdac6-2410-4c00-98ac-3341e6cf81ca None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:11.015430 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70311380-48e6-4a71-bab2-ed04d32ee83b None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:11.028189 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeca6b-c43e-4bad-a169-684370a6fcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:11.028795 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeca6b-c43e-4bad-a169-684370a6fcb8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.029075 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeca6b-c43e-4bad-a169-684370a6fcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.029340 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeca6b-c43e-4bad-a169-684370a6fcb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.029989 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeca6b-c43e-4bad-a169-684370a6fcb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:11.030309 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeca6b-c43e-4bad-a169-684370a6fcb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:11.031659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfeca6b-c43e-4bad-a169-684370a6fcb8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:11.053938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 317/623] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:11.054468 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ec55-9dda-4835-a55e-898cccc31763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:11.059683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ec55-9dda-4835-a55e-898cccc31763 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.060277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ec55-9dda-4835-a55e-898cccc31763 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.060803 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeca6b-c43e-4bad-a169-684370a6fcb8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:11.060996 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344ec55-9dda-4835-a55e-898cccc31763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.081926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344ec55-9dda-4835-a55e-898cccc31763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:11.085547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344ec55-9dda-4835-a55e-898cccc31763 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f344ec55-9dda-4835-a55e-898cccc31763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:11.106231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:11.107175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:11.108040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:11.108040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:11.108040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:11.118178 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 307/624] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:11.119105 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ec55-9dda-4835-a55e-898cccc31763 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:11.125557 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.223224 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.243207 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344ec55-9dda-4835-a55e-898cccc31763 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:11.243690 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeca6b-c43e-4bad-a169-684370a6fcb8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:11.282975 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604b677-d0d9-4fd7-99d4-5b5d2c53e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:11.283753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604b677-d0d9-4fd7-99d4-5b5d2c53e579 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.284139 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604b677-d0d9-4fd7-99d4-5b5d2c53e579 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.284514 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604b677-d0d9-4fd7-99d4-5b5d2c53e579 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.285377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604b677-d0d9-4fd7-99d4-5b5d2c53e579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:11.285815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604b677-d0d9-4fd7-99d4-5b5d2c53e579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:11.286885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f76ce-7d68-4499-8734-cdc4e861a8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:11.287449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604b677-d0d9-4fd7-99d4-5b5d2c53e579 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:11.287821 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f76ce-7d68-4499-8734-cdc4e861a8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.288240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f76ce-7d68-4499-8734-cdc4e861a8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.288667 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f76ce-7d68-4499-8734-cdc4e861a8b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.296987 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f76ce-7d68-4499-8734-cdc4e861a8b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:11.300232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f76ce-7d68-4499-8734-cdc4e861a8b1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:11.301245 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 308/625] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:11.302835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0087a9-4b27-4afd-b98c-0b0ebb30b1e9 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.303122 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0087a9-4b27-4afd-b98c-0b0ebb30b1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.303427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0087a9-4b27-4afd-b98c-0b0ebb30b1e9 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.308765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 309/626] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:11.309535 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0087a9-4b27-4afd-b98c-0b0ebb30b1e9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-2d7f76ce-7d68-4499-8734-cdc4e861a8b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:11.314500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:11.315579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:11.316655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:11.316655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:11.316655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:11.316655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:11.316655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:11.316655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:11.316655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:11.316655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:11.319044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 318/627] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:11.319976 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f76ce-7d68-4499-8734-cdc4e861a8b1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:11.380956 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.423773 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0087a9-4b27-4afd-b98c-0b0ebb30b1e9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:11.427984 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f76ce-7d68-4499-8734-cdc4e861a8b1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:11.461173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98905dd1-52c7-44a0-9351-6b3a914baf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:11.461872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98905dd1-52c7-44a0-9351-6b3a914baf9b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.462133 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98905dd1-52c7-44a0-9351-6b3a914baf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.462411 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98905dd1-52c7-44a0-9351-6b3a914baf9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.464767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b909-bfa0-4e8d-90fc-7c7fa1fe5b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:11.465386 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b909-bfa0-4e8d-90fc-7c7fa1fe5b1f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.465944 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b909-bfa0-4e8d-90fc-7c7fa1fe5b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.466248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b909-bfa0-4e8d-90fc-7c7fa1fe5b1f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.473342 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98905dd1-52c7-44a0-9351-6b3a914baf9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:11.474264 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8b909-bfa0-4e8d-90fc-7c7fa1fe5b1f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:11.475707 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8b909-bfa0-4e8d-90fc-7c7fa1fe5b1f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-98905dd1-52c7-44a0-9351-6b3a914baf9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:11.478623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:11.479665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:11.480516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 310/628] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:11.481271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eb194-affc-4a5d-9303-b5e3078fa9a4 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.481271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eb194-affc-4a5d-9303-b5e3078fa9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.481271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eb194-affc-4a5d-9303-b5e3078fa9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f0f8b909-bfa0-4e8d-90fc-7c7fa1fe5b1f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:11.493405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:11.495104 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 319/629] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:12:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:11.496434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b909-bfa0-4e8d-90fc-7c7fa1fe5b1f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:11.504583 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-753eb194-affc-4a5d-9303-b5e3078fa9a4 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:11.505630 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.505805 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-753eb194-affc-4a5d-9303-b5e3078fa9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:11.574283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 311/630] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:11.574995 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eb194-affc-4a5d-9303-b5e3078fa9a4 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:11.632408 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b909-bfa0-4e8d-90fc-7c7fa1fe5b1f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:11.639053 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.675398 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac4edb-84d3-4b54-b532-67502b5b8ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:11.676110 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac4edb-84d3-4b54-b532-67502b5b8ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.676391 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac4edb-84d3-4b54-b532-67502b5b8ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.676667 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ac4edb-84d3-4b54-b532-67502b5b8ee3 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.677372 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac4edb-84d3-4b54-b532-67502b5b8ee3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:11.677676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac4edb-84d3-4b54-b532-67502b5b8ee3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:11.679153 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ac4edb-84d3-4b54-b532-67502b5b8ee3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:11.690052 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eb194-affc-4a5d-9303-b5e3078fa9a4 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:11.693020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 320/631] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:11.693322 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac4edb-84d3-4b54-b532-67502b5b8ee3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:11.731073 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e968aa-f961-4469-952f-fbe182b04e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:11.731672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e968aa-f961-4469-952f-fbe182b04e5c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.731946 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e968aa-f961-4469-952f-fbe182b04e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.732211 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e968aa-f961-4469-952f-fbe182b04e5c None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.732860 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e968aa-f961-4469-952f-fbe182b04e5c None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:11.733153 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e968aa-f961-4469-952f-fbe182b04e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:11.734545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e968aa-f961-4469-952f-fbe182b04e5c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:11.746172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 312/632] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:11.746172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34a5b-9d1a-454b-ab91-8ac17b174649 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.746172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34a5b-9d1a-454b-ab91-8ac17b174649 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.746172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f34a5b-9d1a-454b-ab91-8ac17b174649 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.746775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 313/633] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:11.747407 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f34a5b-9d1a-454b-ab91-8ac17b174649 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:11.766155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.803183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ac4edb-84d3-4b54-b532-67502b5b8ee3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:11.839375 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74169126-803c-40a5-865d-0261a1a98790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:11.840125 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74169126-803c-40a5-865d-0261a1a98790 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.840778 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74169126-803c-40a5-865d-0261a1a98790 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.841143 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74169126-803c-40a5-865d-0261a1a98790 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.842309 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74169126-803c-40a5-865d-0261a1a98790 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:11.842445 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74169126-803c-40a5-865d-0261a1a98790 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:11.843807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74169126-803c-40a5-865d-0261a1a98790 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:11.852557 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f34a5b-9d1a-454b-ab91-8ac17b174649 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:11.862113 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 321/634] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 07:12:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:11.862941 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74169126-803c-40a5-865d-0261a1a98790 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:11.870779 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:11.888779 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73824543-efdb-4e35-9f86-d2c3a1addecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:11.889728 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824543-efdb-4e35-9f86-d2c3a1addecf None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.890120 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824543-efdb-4e35-9f86-d2c3a1addecf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.890654 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73824543-efdb-4e35-9f86-d2c3a1addecf None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/b115a3ce93804ddbaf542934addb506b/roles/66779f51859f47aa886ee36ac8501a65` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.904749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73824543-efdb-4e35-9f86-d2c3a1addecf None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=b115a3ce93804ddbaf542934addb506b, role_id=66779f51859f47aa886ee36ac8501a65)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:11.906226 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73824543-efdb-4e35-9f86-d2c3a1addecf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:11.957098 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 314/635] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:12:11 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/b115a3ce93804ddbaf542934addb506b/roles/66779f51859f47aa886ee36ac8501a65 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:12:11.958337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47890c3-9b18-477f-8f45-1bc2318f8190 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:11.958690 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47890c3-9b18-477f-8f45-1bc2318f8190 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:11.959010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47890c3-9b18-477f-8f45-1bc2318f8190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:11.960817 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74169126-803c-40a5-865d-0261a1a98790 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:11.979567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e47890c3-9b18-477f-8f45-1bc2318f8190 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:11.980802 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e47890c3-9b18-477f-8f45-1bc2318f8190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:11.989693 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:12.007035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd047b-794c-41d2-bd3c-9f4cceac76fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:12.007651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd047b-794c-41d2-bd3c-9f4cceac76fb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:12.008018 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd047b-794c-41d2-bd3c-9f4cceac76fb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:12.008296 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd047b-794c-41d2-bd3c-9f4cceac76fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:12.020873 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd047b-794c-41d2-bd3c-9f4cceac76fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:12.022493 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd047b-794c-41d2-bd3c-9f4cceac76fb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-abbd047b-794c-41d2-bd3c-9f4cceac76fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:12.038907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:12.039905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:12.040767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:12.040767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:12.040767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:12.040767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 322/636] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:12.040986 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd047b-794c-41d2-bd3c-9f4cceac76fb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:12.069366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 315/637] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:12.070613 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47890c3-9b18-477f-8f45-1bc2318f8190 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:12.173289 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd047b-794c-41d2-bd3c-9f4cceac76fb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:12.208756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47890c3-9b18-477f-8f45-1bc2318f8190 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:12.220079 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a07a2-1e3e-4177-8091-220924a7b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:12.220684 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:12.221111 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a07a2-1e3e-4177-8091-220924a7b0aa None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:12.221389 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a07a2-1e3e-4177-8091-220924a7b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:12.221661 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a07a2-1e3e-4177-8091-220924a7b0aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:12.236451 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a07a2-1e3e-4177-8091-220924a7b0aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-4a6a07a2-1e3e-4177-8091-220924a7b0aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:12.243504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:12.244411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:12.245442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 323/638] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:12.246400 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a07a2-1e3e-4177-8091-220924a7b0aa None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:12.246474 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cbd10-628e-4e98-9bf8-ba2f3b9365b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:12.246678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cbd10-628e-4e98-9bf8-ba2f3b9365b4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:12.247239 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cbd10-628e-4e98-9bf8-ba2f3b9365b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:12.249327 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cbd10-628e-4e98-9bf8-ba2f3b9365b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:12.290656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:12.319245 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cbd10-628e-4e98-9bf8-ba2f3b9365b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:12.320836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cbd10-628e-4e98-9bf8-ba2f3b9365b4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:12.375267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a07a2-1e3e-4177-8091-220924a7b0aa None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:12.413761 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e41002-0fee-40da-b782-ec34043cae81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:12.414399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41002-0fee-40da-b782-ec34043cae81 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:12.414683 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41002-0fee-40da-b782-ec34043cae81 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:12.415011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e41002-0fee-40da-b782-ec34043cae81 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:12.416093 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e41002-0fee-40da-b782-ec34043cae81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:12.416411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e41002-0fee-40da-b782-ec34043cae81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:12.417800 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e41002-0fee-40da-b782-ec34043cae81 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:12.422243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:12.435239 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 324/639] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:12.435239 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e41002-0fee-40da-b782-ec34043cae81 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:12.435531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 316/640] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:12.435531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cbd10-628e-4e98-9bf8-ba2f3b9365b4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:12.537502 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:12.538409 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cbd10-628e-4e98-9bf8-ba2f3b9365b4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:12.543447 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e41002-0fee-40da-b782-ec34043cae81 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:12.575364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d42d-0d22-4ff9-9f7f-5ff6883be35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:12.576223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d42d-0d22-4ff9-9f7f-5ff6883be35c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:12.576223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d42d-0d22-4ff9-9f7f-5ff6883be35c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:12.576511 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47d42d-0d22-4ff9-9f7f-5ff6883be35c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:12.584264 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342d425-83be-4069-a3e7-81fb3019f41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:12.585523 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d425-83be-4069-a3e7-81fb3019f41f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:12.585523 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d425-83be-4069-a3e7-81fb3019f41f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:12.585685 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342d425-83be-4069-a3e7-81fb3019f41f None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:12.586475 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342d425-83be-4069-a3e7-81fb3019f41f None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:12.586781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342d425-83be-4069-a3e7-81fb3019f41f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:12.586880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47d42d-0d22-4ff9-9f7f-5ff6883be35c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:12.588163 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342d425-83be-4069-a3e7-81fb3019f41f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-9c47d42d-0d22-4ff9-9f7f-5ff6883be35c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:12.591670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:12.592564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 317/641] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:12.597595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d42d-0d22-4ff9-9f7f-5ff6883be35c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:12.606978 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 325/642] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:12.608038 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342d425-83be-4069-a3e7-81fb3019f41f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:12.656373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:12.703316 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47d42d-0d22-4ff9-9f7f-5ff6883be35c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:12.718060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342d425-83be-4069-a3e7-81fb3019f41f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:12.738768 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cce19-1e59-45cb-a9ee-3c0068c28381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:12.739393 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cce19-1e59-45cb-a9ee-3c0068c28381 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:12.739672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cce19-1e59-45cb-a9ee-3c0068c28381 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:12.740218 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1cce19-1e59-45cb-a9ee-3c0068c28381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:12.750508 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cce19-1e59-45cb-a9ee-3c0068c28381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:12.752178 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1cce19-1e59-45cb-a9ee-3c0068c28381 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:12.755206 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7ee77-2588-4507-add8-ead7d244f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:12.755822 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7ee77-2588-4507-add8-ead7d244f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:12.756103 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7ee77-2588-4507-add8-ead7d244f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:12.756377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7ee77-2588-4507-add8-ead7d244f1f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:12.764525 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7ee77-2588-4507-add8-ead7d244f1f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-5c1cce19-1e59-45cb-a9ee-3c0068c28381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:12.765756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:12.767055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:12.767971 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:12.767971 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:12.767971 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:12.768148 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7ee77-2588-4507-add8-ead7d244f1f4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:12.768227 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 318/643] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:12.768227 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cce19-1e59-45cb-a9ee-3c0068c28381 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-71c7ee77-2588-4507-add8-ead7d244f1f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:12.780136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:12.781281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:12.782808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:12.782808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:12.782808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:12.782808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:12.782808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:12.782808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:12.782808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:12.782808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:12.782808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:12:12.782808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:12.782808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 326/644] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 07:12:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:12.783676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7ee77-2588-4507-add8-ead7d244f1f4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:12.804055 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:12.880351 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1cce19-1e59-45cb-a9ee-3c0068c28381 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:12.889039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:12.896808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7ee77-2588-4507-add8-ead7d244f1f4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:12.914681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7037c9-6666-490a-b896-0736f479e20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:12.915287 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7037c9-6666-490a-b896-0736f479e20b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:12.915566 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7037c9-6666-490a-b896-0736f479e20b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:12.915836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7037c9-6666-490a-b896-0736f479e20b None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:12.916534 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7037c9-6666-490a-b896-0736f479e20b None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:12.916833 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7037c9-6666-490a-b896-0736f479e20b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:12.918216 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7037c9-6666-490a-b896-0736f479e20b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:12.926918 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 319/645] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:12.927704 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7037c9-6666-490a-b896-0736f479e20b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:12.939166 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9daa6-d8cd-4597-bafd-f580cd97bd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:12.939904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9daa6-d8cd-4597-bafd-f580cd97bd95 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:12.940184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9daa6-d8cd-4597-bafd-f580cd97bd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:12.940451 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9daa6-d8cd-4597-bafd-f580cd97bd95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:12.950940 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9daa6-d8cd-4597-bafd-f580cd97bd95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:12.952382 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f9daa6-d8cd-4597-bafd-f580cd97bd95 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-48f9daa6-d8cd-4597-bafd-f580cd97bd95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:12.967887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:12.968818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:12.970616 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:12.970616 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:12.970616 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:12.970616 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 327/646] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:12.970616 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9daa6-d8cd-4597-bafd-f580cd97bd95 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.042674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:13.043021 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7037c9-6666-490a-b896-0736f479e20b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:13.074691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9daa6-d8cd-4597-bafd-f580cd97bd95 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:13.077983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810f20b-abb4-47fc-9959-1669d19daeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:13.078630 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810f20b-abb4-47fc-9959-1669d19daeab None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:13.079431 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810f20b-abb4-47fc-9959-1669d19daeab None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:13.079694 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810f20b-abb4-47fc-9959-1669d19daeab None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:13.080394 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810f20b-abb4-47fc-9959-1669d19daeab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:13.080643 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810f20b-abb4-47fc-9959-1669d19daeab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:13.082141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810f20b-abb4-47fc-9959-1669d19daeab None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:13.097261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 320/647] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:13.098118 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810f20b-abb4-47fc-9959-1669d19daeab None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.115213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d655a-3193-4eed-9281-8a4fcdae0635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:13.115829 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d655a-3193-4eed-9281-8a4fcdae0635 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:13.116165 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d655a-3193-4eed-9281-8a4fcdae0635 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:13.116438 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d655a-3193-4eed-9281-8a4fcdae0635 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:13.117204 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d655a-3193-4eed-9281-8a4fcdae0635 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:13.117511 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d655a-3193-4eed-9281-8a4fcdae0635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:13.118962 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d655a-3193-4eed-9281-8a4fcdae0635 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:13.133506 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:13.137710 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 328/648] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 07:12:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:13.143561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d655a-3193-4eed-9281-8a4fcdae0635 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.207707 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810f20b-abb4-47fc-9959-1669d19daeab None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:13.241218 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d39b78-eb8a-4084-86b3-9b5af479ccce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:13.241762 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39b78-eb8a-4084-86b3-9b5af479ccce None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:13.242035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39b78-eb8a-4084-86b3-9b5af479ccce None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:13.242331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d39b78-eb8a-4084-86b3-9b5af479ccce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:13.248698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d655a-3193-4eed-9281-8a4fcdae0635 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:13.253207 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d39b78-eb8a-4084-86b3-9b5af479ccce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:13.254675 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d39b78-eb8a-4084-86b3-9b5af479ccce None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-67d39b78-eb8a-4084-86b3-9b5af479ccce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:13.269664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:13.270815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:13.272186 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:13.272186 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:13.272186 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:13.272186 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 321/649] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:13.272186 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d39b78-eb8a-4084-86b3-9b5af479ccce None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.281911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:13.292126 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73877feb-4d88-4f30-9c81-f1d6f9cac90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:13.292730 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73877feb-4d88-4f30-9c81-f1d6f9cac90c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:13.293015 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73877feb-4d88-4f30-9c81-f1d6f9cac90c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:13.293277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73877feb-4d88-4f30-9c81-f1d6f9cac90c None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:13.293987 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73877feb-4d88-4f30-9c81-f1d6f9cac90c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:13.294833 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73877feb-4d88-4f30-9c81-f1d6f9cac90c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:13.296484 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73877feb-4d88-4f30-9c81-f1d6f9cac90c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:13.316242 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 329/650] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:13.317120 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73877feb-4d88-4f30-9c81-f1d6f9cac90c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.361342 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:13.381319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d39b78-eb8a-4084-86b3-9b5af479ccce None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:13.419186 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b3927-2cb0-46f2-8953-b6fbe6fac70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:13.419842 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b3927-2cb0-46f2-8953-b6fbe6fac70b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:13.420122 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b3927-2cb0-46f2-8953-b6fbe6fac70b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:13.420395 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b3927-2cb0-46f2-8953-b6fbe6fac70b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:13.421516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73877feb-4d88-4f30-9c81-f1d6f9cac90c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:13.427560 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b3927-2cb0-46f2-8953-b6fbe6fac70b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:13.429130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b3927-2cb0-46f2-8953-b6fbe6fac70b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d29b3927-2cb0-46f2-8953-b6fbe6fac70b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:13.442017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:13.443121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:13.444220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:13.444220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:13.444220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:13.444220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:13.444220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:13.444220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:13.444220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:13.444220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:13.448140 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 322/651] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:13.448835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b3927-2cb0-46f2-8953-b6fbe6fac70b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.459004 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3b14c-1965-4839-9207-1c2fd7053c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:13.459697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3b14c-1965-4839-9207-1c2fd7053c74 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:13.460037 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3b14c-1965-4839-9207-1c2fd7053c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:13.460371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f3b14c-1965-4839-9207-1c2fd7053c74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:13.517112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:13.529315 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3b14c-1965-4839-9207-1c2fd7053c74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:13.530860 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f3b14c-1965-4839-9207-1c2fd7053c74 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:13.557777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b3927-2cb0-46f2-8953-b6fbe6fac70b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:13.599595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66ab6-9bce-4041-b2dd-3bedf0467303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:13.600312 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66ab6-9bce-4041-b2dd-3bedf0467303 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:13.600663 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66ab6-9bce-4041-b2dd-3bedf0467303 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:13.601078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e66ab6-9bce-4041-b2dd-3bedf0467303 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:13.601805 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66ab6-9bce-4041-b2dd-3bedf0467303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:13.602209 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66ab6-9bce-4041-b2dd-3bedf0467303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:13.603654 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e66ab6-9bce-4041-b2dd-3bedf0467303 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:13.621392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 323/652] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:13.622180 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66ab6-9bce-4041-b2dd-3bedf0467303 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.624901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:13.639719 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 330/653] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:13.640578 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3b14c-1965-4839-9207-1c2fd7053c74 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.731187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:13.736462 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e66ab6-9bce-4041-b2dd-3bedf0467303 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:13.742989 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f3b14c-1965-4839-9207-1c2fd7053c74 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:13.771960 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c918d1-dc4a-49e9-8e92-1038fa2213c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:13.772512 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c918d1-dc4a-49e9-8e92-1038fa2213c6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:13.772781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c918d1-dc4a-49e9-8e92-1038fa2213c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:13.773058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c918d1-dc4a-49e9-8e92-1038fa2213c6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:13.777801 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69da0d-e6f3-4fdd-81c6-bcebbd8b46d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:13.778432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69da0d-e6f3-4fdd-81c6-bcebbd8b46d3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:13.778715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69da0d-e6f3-4fdd-81c6-bcebbd8b46d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:13.778990 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69da0d-e6f3-4fdd-81c6-bcebbd8b46d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:13.779685 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69da0d-e6f3-4fdd-81c6-bcebbd8b46d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:13.779991 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69da0d-e6f3-4fdd-81c6-bcebbd8b46d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:13.781538 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69da0d-e6f3-4fdd-81c6-bcebbd8b46d3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:13.781639 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c918d1-dc4a-49e9-8e92-1038fa2213c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:13.784104 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c918d1-dc4a-49e9-8e92-1038fa2213c6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:13.799444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 331/654] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:13.799444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69da0d-e6f3-4fdd-81c6-bcebbd8b46d3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-46c918d1-dc4a-49e9-8e92-1038fa2213c6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:13.799680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:13.800523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 324/655] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:12:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:13.801443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c918d1-dc4a-49e9-8e92-1038fa2213c6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.866601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:13.907955 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c918d1-dc4a-49e9-8e92-1038fa2213c6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:13.908715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69da0d-e6f3-4fdd-81c6-bcebbd8b46d3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:13.943326 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e70ad-e5f5-4067-a16a-a76a78269ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:13.943949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e70ad-e5f5-4067-a16a-a76a78269ffc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:13.944229 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e70ad-e5f5-4067-a16a-a76a78269ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:13.944497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e70ad-e5f5-4067-a16a-a76a78269ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:13.945055 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3c15a-fbbf-4d21-8d43-3cdca4c2b5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:13.945675 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3c15a-fbbf-4d21-8d43-3cdca4c2b5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:13.945959 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3c15a-fbbf-4d21-8d43-3cdca4c2b5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:13.946278 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3c15a-fbbf-4d21-8d43-3cdca4c2b5d8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:13.953804 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3c15a-fbbf-4d21-8d43-3cdca4c2b5d8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:13.955198 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e70ad-e5f5-4067-a16a-a76a78269ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:13.955338 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3c15a-fbbf-4d21-8d43-3cdca4c2b5d8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:13.956683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e70ad-e5f5-4067-a16a-a76a78269ffc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-20e3c15a-fbbf-4d21-8d43-3cdca4c2b5d8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:13.966428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:13.967336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 332/656] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:13.968249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3c15a-fbbf-4d21-8d43-3cdca4c2b5d8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a43e70ad-e5f5-4067-a16a-a76a78269ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:13.971157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:13.972033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:13.973684 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:13.973684 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:13.973684 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:13.973684 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 325/657] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:13.973684 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e70ad-e5f5-4067-a16a-a76a78269ffc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:13.981446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:14.067796 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3c15a-fbbf-4d21-8d43-3cdca4c2b5d8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:14.068967 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e70ad-e5f5-4067-a16a-a76a78269ffc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:14.083043 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:14.101402 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e389dd-8aec-46ed-9f3a-dd3367a73019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:14.101989 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e389dd-8aec-46ed-9f3a-dd3367a73019 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:14.102298 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e389dd-8aec-46ed-9f3a-dd3367a73019 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:14.102568 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e389dd-8aec-46ed-9f3a-dd3367a73019 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:14.103343 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e389dd-8aec-46ed-9f3a-dd3367a73019 None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=790353a3d5d543bca467802f1d9fd6fb) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:14.103650 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e389dd-8aec-46ed-9f3a-dd3367a73019 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:14.104155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0b4b2-a656-416b-8727-4e3ed10f1d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:14.104751 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0b4b2-a656-416b-8727-4e3ed10f1d1d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:14.105026 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0b4b2-a656-416b-8727-4e3ed10f1d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:14.105118 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e389dd-8aec-46ed-9f3a-dd3367a73019 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:14.105298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0b4b2-a656-416b-8727-4e3ed10f1d1d None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:14.106010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0b4b2-a656-416b-8727-4e3ed10f1d1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:14.106351 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0b4b2-a656-416b-8727-4e3ed10f1d1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:14.107754 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0b4b2-a656-416b-8727-4e3ed10f1d1d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:14.111289 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 333/658] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:13 2022] GET /identity/v3/role_assignments?user.id=790353a3d5d543bca467802f1d9fd6fb&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:14.112421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7269b-2094-4e34-80f5-fc9385222090 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:14.112701 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7269b-2094-4e34-80f5-fc9385222090 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:14.112969 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7269b-2094-4e34-80f5-fc9385222090 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:14.118331 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 334/659] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:14.118331 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7269b-2094-4e34-80f5-fc9385222090 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:14.131404 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 326/660] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 23 07:12:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:14.132277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0b4b2-a656-416b-8727-4e3ed10f1d1d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:14.207212 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:14.241276 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7269b-2094-4e34-80f5-fc9385222090 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:14.247309 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0b4b2-a656-416b-8727-4e3ed10f1d1d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:14.285398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cda3d-b7bb-4d38-871f-99205b94d499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:14.286027 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cda3d-b7bb-4d38-871f-99205b94d499 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:14.286333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cda3d-b7bb-4d38-871f-99205b94d499 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:14.286599 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cda3d-b7bb-4d38-871f-99205b94d499 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:14.287625 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cda3d-b7bb-4d38-871f-99205b94d499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:14.287625 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cda3d-b7bb-4d38-871f-99205b94d499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:14.288870 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cda3d-b7bb-4d38-871f-99205b94d499 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:14.289934 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c611-6d30-4aed-946a-1ac1d0007942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:14.290440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c611-6d30-4aed-946a-1ac1d0007942 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:14.290653 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c611-6d30-4aed-946a-1ac1d0007942 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:14.290930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345c611-6d30-4aed-946a-1ac1d0007942 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:14.291664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345c611-6d30-4aed-946a-1ac1d0007942 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:14.291972 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345c611-6d30-4aed-946a-1ac1d0007942 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:14.293949 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345c611-6d30-4aed-946a-1ac1d0007942 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:14.303489 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 327/661] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:14.304493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb88856-d1f3-4f22-9ee4-ec61ead1ceb1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:14.304768 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb88856-d1f3-4f22-9ee4-ec61ead1ceb1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:14.305798 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb88856-d1f3-4f22-9ee4-ec61ead1ceb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:14.315140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 335/662] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 23 07:12:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:14.316513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c611-6d30-4aed-946a-1ac1d0007942 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:14.324997 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-dcb88856-d1f3-4f22-9ee4-ec61ead1ceb1 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:14.326095 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dcb88856-d1f3-4f22-9ee4-ec61ead1ceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:14.353317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:14.397310 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 328/663] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:14.398578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb88856-d1f3-4f22-9ee4-ec61ead1ceb1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:14.433847 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345c611-6d30-4aed-946a-1ac1d0007942 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:14.463752 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:14.469678 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfe18f-fecd-4163-a9eb-e9d060182c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:14.470548 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfe18f-fecd-4163-a9eb-e9d060182c8b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:14.470684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfe18f-fecd-4163-a9eb-e9d060182c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:14.470856 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfe18f-fecd-4163-a9eb-e9d060182c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:14.512353 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb88856-d1f3-4f22-9ee4-ec61ead1ceb1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:14.540691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfe18f-fecd-4163-a9eb-e9d060182c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:14.542172 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dfe18f-fecd-4163-a9eb-e9d060182c8b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:14.551691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daa031-f3dc-4a57-b979-2ead0628aa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:14.552657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa031-f3dc-4a57-b979-2ead0628aa8d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:14.553256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa031-f3dc-4a57-b979-2ead0628aa8d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:14.553723 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7daa031-f3dc-4a57-b979-2ead0628aa8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:14.561525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daa031-f3dc-4a57-b979-2ead0628aa8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:14.563835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7daa031-f3dc-4a57-b979-2ead0628aa8d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e7daa031-f3dc-4a57-b979-2ead0628aa8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:14.576567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:14.577467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:14.578387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:14.578387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:14.578387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:14.578387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:14.578387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:14.578387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:14.578387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:14.578387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:14.581460 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 329/664] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:14.582498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daa031-f3dc-4a57-b979-2ead0628aa8d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:14.614888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:14.676958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 336/665] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:14.676958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfe18f-fecd-4163-a9eb-e9d060182c8b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:14.710249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:14.722458 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7daa031-f3dc-4a57-b979-2ead0628aa8d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:14.758512 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8dd6f-53ed-4871-b415-fd557db357d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:14.759127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8dd6f-53ed-4871-b415-fd557db357d5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:14.759401 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8dd6f-53ed-4871-b415-fd557db357d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:14.759675 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce8dd6f-53ed-4871-b415-fd557db357d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:14.788505 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfe18f-fecd-4163-a9eb-e9d060182c8b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:14.829811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8dd6f-53ed-4871-b415-fd557db357d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:14.831206 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce8dd6f-53ed-4871-b415-fd557db357d5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:14.831550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0543b2-df52-4ee0-bfb1-8f74da43be0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:14.832144 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0543b2-df52-4ee0-bfb1-8f74da43be0b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:14.832447 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0543b2-df52-4ee0-bfb1-8f74da43be0b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:14.832691 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0543b2-df52-4ee0-bfb1-8f74da43be0b None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:14.833372 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0543b2-df52-4ee0-bfb1-8f74da43be0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:14.833669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0543b2-df52-4ee0-bfb1-8f74da43be0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:14.835103 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0543b2-df52-4ee0-bfb1-8f74da43be0b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:14.852861 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 337/666] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:14.852861 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0543b2-df52-4ee0-bfb1-8f74da43be0b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:14.860774 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:14.937373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 330/667] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:14.938689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8dd6f-53ed-4871-b415-fd557db357d5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:14.961550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:14.972706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0543b2-df52-4ee0-bfb1-8f74da43be0b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:15.011281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53002168-511a-4abf-973e-8adc6fe6a3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:15.011898 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53002168-511a-4abf-973e-8adc6fe6a3bb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:15.012347 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53002168-511a-4abf-973e-8adc6fe6a3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:15.012621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53002168-511a-4abf-973e-8adc6fe6a3bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:15.023430 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53002168-511a-4abf-973e-8adc6fe6a3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:15.024882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53002168-511a-4abf-973e-8adc6fe6a3bb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-53002168-511a-4abf-973e-8adc6fe6a3bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:15.040851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:15.041782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:15.043065 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:15.043065 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:15.043065 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:15.043065 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 338/668] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:15.043065 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53002168-511a-4abf-973e-8adc6fe6a3bb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:15.056228 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce8dd6f-53ed-4871-b415-fd557db357d5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:15.079417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:15.094420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccfbfd-e85c-4fcf-837c-f921f3dc22f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:15.095949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccfbfd-e85c-4fcf-837c-f921f3dc22f7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:15.096219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccfbfd-e85c-4fcf-837c-f921f3dc22f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:15.096492 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccfbfd-e85c-4fcf-837c-f921f3dc22f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:15.107850 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccfbfd-e85c-4fcf-837c-f921f3dc22f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1cccfbfd-e85c-4fcf-837c-f921f3dc22f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:15.113283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:15.114413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:15.115398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 331/669] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:15.119158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccfbfd-e85c-4fcf-837c-f921f3dc22f7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:15.162317 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53002168-511a-4abf-973e-8adc6fe6a3bb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:15.208264 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315a791-8d0d-445e-a4ea-a6638158e4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:15.209390 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315a791-8d0d-445e-a4ea-a6638158e4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:15.209824 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315a791-8d0d-445e-a4ea-a6638158e4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:15.210238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315a791-8d0d-445e-a4ea-a6638158e4a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:15.211154 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315a791-8d0d-445e-a4ea-a6638158e4a1 None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=bb99f54d9320496cbcc52d535fa64789) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:15.211571 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315a791-8d0d-445e-a4ea-a6638158e4a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:15.214002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315a791-8d0d-445e-a4ea-a6638158e4a1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:15.222752 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 339/670] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:15 2022] GET /identity/v3/role_assignments?user.id=bb99f54d9320496cbcc52d535fa64789&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:15.223651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315a791-8d0d-445e-a4ea-a6638158e4a1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:15.233561 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccfbfd-e85c-4fcf-837c-f921f3dc22f7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:15.238484 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:15.276957 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec149cd7-1800-473b-be52-b0796b1e5944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:15.277988 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec149cd7-1800-473b-be52-b0796b1e5944 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:15.278491 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec149cd7-1800-473b-be52-b0796b1e5944 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:15.279006 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec149cd7-1800-473b-be52-b0796b1e5944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:15.292045 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec149cd7-1800-473b-be52-b0796b1e5944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:15.293894 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec149cd7-1800-473b-be52-b0796b1e5944 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ec149cd7-1800-473b-be52-b0796b1e5944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:15.312343 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:15.314088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:15.315001 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:15.315001 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:15.315001 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:15.315863 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 332/671] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:15.316559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec149cd7-1800-473b-be52-b0796b1e5944 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:15.358831 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315a791-8d0d-445e-a4ea-a6638158e4a1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:15.359768 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:15.405408 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1948a-4a3c-486f-9d4e-76b3af7e4168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:15.408246 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1948a-4a3c-486f-9d4e-76b3af7e4168 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:15.408246 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1948a-4a3c-486f-9d4e-76b3af7e4168 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:15.408246 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1948a-4a3c-486f-9d4e-76b3af7e4168 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:15.408477 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1948a-4a3c-486f-9d4e-76b3af7e4168 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:15.408709 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1948a-4a3c-486f-9d4e-76b3af7e4168 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:15.411212 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1948a-4a3c-486f-9d4e-76b3af7e4168 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:15.426886 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 340/672] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:15.428230 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1948a-4a3c-486f-9d4e-76b3af7e4168 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:15.454514 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec149cd7-1800-473b-be52-b0796b1e5944 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:15.505996 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77eb5d-d296-417f-aaea-3a22607b9ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:15.506756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77eb5d-d296-417f-aaea-3a22607b9ecf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:15.507121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77eb5d-d296-417f-aaea-3a22607b9ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:15.507464 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77eb5d-d296-417f-aaea-3a22607b9ecf None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:15.508196 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77eb5d-d296-417f-aaea-3a22607b9ecf None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:15.508565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77eb5d-d296-417f-aaea-3a22607b9ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:15.509988 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77eb5d-d296-417f-aaea-3a22607b9ecf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:15.514727 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:15.519520 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 333/673] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:15.524637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77eb5d-d296-417f-aaea-3a22607b9ecf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:15.554858 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1948a-4a3c-486f-9d4e-76b3af7e4168 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:15.595243 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cc2d1-a44f-41bb-9dd0-b17e7b3826ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:15.595243 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc2d1-a44f-41bb-9dd0-b17e7b3826ef None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:15.595243 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc2d1-a44f-41bb-9dd0-b17e7b3826ef None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:15.595243 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110cc2d1-a44f-41bb-9dd0-b17e7b3826ef None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:15.595696 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cc2d1-a44f-41bb-9dd0-b17e7b3826ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:15.597899 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cc2d1-a44f-41bb-9dd0-b17e7b3826ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:15.599436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110cc2d1-a44f-41bb-9dd0-b17e7b3826ef None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:15.643695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:15.651196 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77eb5d-d296-417f-aaea-3a22607b9ecf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:15.691754 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9e250-221f-4049-a6d6-bcb718ebd78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:15.692399 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9e250-221f-4049-a6d6-bcb718ebd78a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:15.692678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9e250-221f-4049-a6d6-bcb718ebd78a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:15.692949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9e250-221f-4049-a6d6-bcb718ebd78a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:15.701272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9e250-221f-4049-a6d6-bcb718ebd78a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:15.702843 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d9e250-221f-4049-a6d6-bcb718ebd78a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-43d9e250-221f-4049-a6d6-bcb718ebd78a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:15.717187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:15.718359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:15.719879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:15.719879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:15.719879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:15.719879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:15.719879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:15.719879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:15.719879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:15.719879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:15.719879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 334/674] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:15.720395 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9e250-221f-4049-a6d6-bcb718ebd78a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:15.742609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 341/675] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:15.743594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cc2d1-a44f-41bb-9dd0-b17e7b3826ef None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:15.855661 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9e250-221f-4049-a6d6-bcb718ebd78a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:15.881697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110cc2d1-a44f-41bb-9dd0-b17e7b3826ef None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:15.892857 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57008ae1-14aa-4445-b18e-01349f54651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:15.893608 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57008ae1-14aa-4445-b18e-01349f54651f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:15.894089 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57008ae1-14aa-4445-b18e-01349f54651f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:15.894434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57008ae1-14aa-4445-b18e-01349f54651f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:15.905777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57008ae1-14aa-4445-b18e-01349f54651f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:15.908209 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57008ae1-14aa-4445-b18e-01349f54651f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:15.910458 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:15.919725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff777-b0b8-4d63-a831-bf4186c3b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:15.920316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff777-b0b8-4d63-a831-bf4186c3b935 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:15.920624 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff777-b0b8-4d63-a831-bf4186c3b935 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:15.920889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ff777-b0b8-4d63-a831-bf4186c3b935 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:15.921579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff777-b0b8-4d63-a831-bf4186c3b935 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:15.921947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff777-b0b8-4d63-a831-bf4186c3b935 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:15.923846 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ff777-b0b8-4d63-a831-bf4186c3b935 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-57008ae1-14aa-4445-b18e-01349f54651f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:15.929548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:15.930678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:15.931787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:15.931787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:15.931787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:15.931787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 335/676] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:15.931787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57008ae1-14aa-4445-b18e-01349f54651f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:15.942268 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 342/677] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:15.943166 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff777-b0b8-4d63-a831-bf4186c3b935 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:15.949052 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:16.048960 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57008ae1-14aa-4445-b18e-01349f54651f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:16.054359 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ff777-b0b8-4d63-a831-bf4186c3b935 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:16.087069 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc49f3-5fee-43a3-81a6-b6710e39a8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:16.087856 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc49f3-5fee-43a3-81a6-b6710e39a8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:16.088201 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc49f3-5fee-43a3-81a6-b6710e39a8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:16.088664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc49f3-5fee-43a3-81a6-b6710e39a8d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:16.091853 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf06ff-bff8-4001-a3bd-a4ea2b88b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:16.092620 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf06ff-bff8-4001-a3bd-a4ea2b88b4bf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:16.093045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf06ff-bff8-4001-a3bd-a4ea2b88b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:16.093461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf06ff-bff8-4001-a3bd-a4ea2b88b4bf None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:16.094309 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf06ff-bff8-4001-a3bd-a4ea2b88b4bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:16.094997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf06ff-bff8-4001-a3bd-a4ea2b88b4bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:16.096547 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf06ff-bff8-4001-a3bd-a4ea2b88b4bf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:16.096672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc49f3-5fee-43a3-81a6-b6710e39a8d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:16.098362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc49f3-5fee-43a3-81a6-b6710e39a8d1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-18dc49f3-5fee-43a3-81a6-b6710e39a8d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:16.112601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:16.113787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:16.115009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:16.115009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:16.115009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:16.115009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:16.115009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:16.115009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:16.115009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:16.115009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:16.115553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 343/678] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:16.115644 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 336/679] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:16.115730 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf06ff-bff8-4001-a3bd-a4ea2b88b4bf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:16.115820 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff08aa9-ba33-4337-b4eb-52ee649d82f5 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:16.115908 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff08aa9-ba33-4337-b4eb-52ee649d82f5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:16.117702 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff08aa9-ba33-4337-b4eb-52ee649d82f5 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:16.118388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 337/680] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:16.118946 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff08aa9-ba33-4337-b4eb-52ee649d82f5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:16.167385 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:16.189883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:16.225082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf06ff-bff8-4001-a3bd-a4ea2b88b4bf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:16.225874 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff08aa9-ba33-4337-b4eb-52ee649d82f5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:16.261651 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f230c-9c3b-4357-9aba-626e3ec575a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:16.261870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c5bb-17c4-4bcb-b9da-2abd79992c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:16.262277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f230c-9c3b-4357-9aba-626e3ec575a1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:16.262556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f230c-9c3b-4357-9aba-626e3ec575a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:16.262664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c5bb-17c4-4bcb-b9da-2abd79992c3d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:16.262825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f230c-9c3b-4357-9aba-626e3ec575a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:16.263108 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c5bb-17c4-4bcb-b9da-2abd79992c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:16.263470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7c5bb-17c4-4bcb-b9da-2abd79992c3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:16.263573 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f230c-9c3b-4357-9aba-626e3ec575a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:16.263788 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f230c-9c3b-4357-9aba-626e3ec575a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:16.264436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7c5bb-17c4-4bcb-b9da-2abd79992c3d None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=a59542e893d244ca9a268fc388052329) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:16.264848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7c5bb-17c4-4bcb-b9da-2abd79992c3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:16.265202 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f230c-9c3b-4357-9aba-626e3ec575a1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:16.267048 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7c5bb-17c4-4bcb-b9da-2abd79992c3d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:16.278475 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 344/681] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:16 2022] GET /identity/v3/role_assignments?user.id=a59542e893d244ca9a268fc388052329&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:16.279713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c5bb-17c4-4bcb-b9da-2abd79992c3d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:16.283928 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 338/682] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:16.285410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41a763-ff21-4a69-b35c-acc04b65fa1d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:16.285702 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41a763-ff21-4a69-b35c-acc04b65fa1d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:16.285976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41a763-ff21-4a69-b35c-acc04b65fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:16.306638 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2d41a763-ff21-4a69-b35c-acc04b65fa1d None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:16.307906 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2d41a763-ff21-4a69-b35c-acc04b65fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:16.409513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 339/683] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:16.411105 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41a763-ff21-4a69-b35c-acc04b65fa1d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:16.414942 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7c5bb-17c4-4bcb-b9da-2abd79992c3d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:16.427515 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:16.456315 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff952-1f9c-433f-916c-a9d1fb642b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:16.457523 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff952-1f9c-433f-916c-a9d1fb642b3e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:16.457523 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff952-1f9c-433f-916c-a9d1fb642b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:16.457768 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ff952-1f9c-433f-916c-a9d1fb642b3e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:16.468923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ff952-1f9c-433f-916c-a9d1fb642b3e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:16.471467 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ff952-1f9c-433f-916c-a9d1fb642b3e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:16.484896 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b96ff952-1f9c-433f-916c-a9d1fb642b3e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:16.489238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:16.490436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:16.491633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:16.491633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:16.491633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:16.491633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:16.491633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:16.491633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:16.491633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:16.491633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:16.491633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:16.491633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:16.494427 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 345/684] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:16.504080 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff952-1f9c-433f-916c-a9d1fb642b3e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:16.540572 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41a763-ff21-4a69-b35c-acc04b65fa1d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:16.588472 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33e6b7-8a8d-411a-9297-892a074a1371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:16.589432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33e6b7-8a8d-411a-9297-892a074a1371 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:16.589870 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33e6b7-8a8d-411a-9297-892a074a1371 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:16.590572 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33e6b7-8a8d-411a-9297-892a074a1371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:16.591642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33e6b7-8a8d-411a-9297-892a074a1371 None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=e952426a4d6949b3bd9ee5923abd637f) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:16.596468 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33e6b7-8a8d-411a-9297-892a074a1371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:16.598157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33e6b7-8a8d-411a-9297-892a074a1371 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:16.606119 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 340/685] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:16 2022] GET /identity/v3/role_assignments?user.id=e952426a4d6949b3bd9ee5923abd637f&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:16.638068 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ff952-1f9c-433f-916c-a9d1fb642b3e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:16.679066 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132ff49-43df-4dd9-a452-2deac2fe9ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:16.679763 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132ff49-43df-4dd9-a452-2deac2fe9ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:16.680137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132ff49-43df-4dd9-a452-2deac2fe9ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:16.680501 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132ff49-43df-4dd9-a452-2deac2fe9ab9 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:16.681344 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132ff49-43df-4dd9-a452-2deac2fe9ab9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:16.681748 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132ff49-43df-4dd9-a452-2deac2fe9ab9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:16.683351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132ff49-43df-4dd9-a452-2deac2fe9ab9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:16.695826 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33e6b7-8a8d-411a-9297-892a074a1371 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:16.707606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 346/686] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 07:12:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:16.715960 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132ff49-43df-4dd9-a452-2deac2fe9ab9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:16.754491 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:16.856549 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132ff49-43df-4dd9-a452-2deac2fe9ab9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:16.873035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33e6b7-8a8d-411a-9297-892a074a1371 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:16.896141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae4a9f-c698-481b-8dcb-d74070abfc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:16.896754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae4a9f-c698-481b-8dcb-d74070abfc0e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:16.897027 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae4a9f-c698-481b-8dcb-d74070abfc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:16.897292 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae4a9f-c698-481b-8dcb-d74070abfc0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:16.904045 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:16.919504 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dfdd9-239b-452e-8ddb-75937209e6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:16.920300 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfdd9-239b-452e-8ddb-75937209e6be None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:16.920583 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfdd9-239b-452e-8ddb-75937209e6be None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:16.921197 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dfdd9-239b-452e-8ddb-75937209e6be None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:16.921797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dfdd9-239b-452e-8ddb-75937209e6be None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:16.924625 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dfdd9-239b-452e-8ddb-75937209e6be None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3f4dfdd9-239b-452e-8ddb-75937209e6be None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:16.941693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:16.942986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:12:16.944039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:16.946977 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 341/687] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 23 07:12:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:16.951302 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dfdd9-239b-452e-8ddb-75937209e6be None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:16.995147 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae4a9f-c698-481b-8dcb-d74070abfc0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:16.996776 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae4a9f-c698-481b-8dcb-d74070abfc0e None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:17.053057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:17.132522 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 347/688] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 07:12:17.138087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae4a9f-c698-481b-8dcb-d74070abfc0e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:17.181594 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dfdd9-239b-452e-8ddb-75937209e6be None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:17.252874 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc3df7-e1bb-419f-8649-be16ba986380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:17.253407 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc3df7-e1bb-419f-8649-be16ba986380 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:17.253689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc3df7-e1bb-419f-8649-be16ba986380 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:17.253959 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc3df7-e1bb-419f-8649-be16ba986380 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:17.256816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc3df7-e1bb-419f-8649-be16ba986380 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:17.257154 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc3df7-e1bb-419f-8649-be16ba986380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:17.258571 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc3df7-e1bb-419f-8649-be16ba986380 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:17.269986 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 342/689] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 07:12:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:17.275689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc3df7-e1bb-419f-8649-be16ba986380 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:17.324799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae4a9f-c698-481b-8dcb-d74070abfc0e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:17.353434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:17.365693 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0669b0f-8e1b-4564-a171-5b1d4f951da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:17.366363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0669b0f-8e1b-4564-a171-5b1d4f951da3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:17.366642 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0669b0f-8e1b-4564-a171-5b1d4f951da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:17.366911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0669b0f-8e1b-4564-a171-5b1d4f951da3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:17.381643 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:17.389606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0669b0f-8e1b-4564-a171-5b1d4f951da3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:17.392501 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0669b0f-8e1b-4564-a171-5b1d4f951da3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d0669b0f-8e1b-4564-a171-5b1d4f951da3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:17.411946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:17.418749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:17.419622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:17.419622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:17.419622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:17.419622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 348/690] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:17.423624 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0669b0f-8e1b-4564-a171-5b1d4f951da3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:17.458003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc3df7-e1bb-419f-8649-be16ba986380 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:17.504120 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec11e8-1dea-4ec1-bfd2-3e365ac86810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:17.504659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec11e8-1dea-4ec1-bfd2-3e365ac86810 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:17.504933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec11e8-1dea-4ec1-bfd2-3e365ac86810 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:17.505200 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec11e8-1dea-4ec1-bfd2-3e365ac86810 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:17.505821 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec11e8-1dea-4ec1-bfd2-3e365ac86810 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:17.506127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec11e8-1dea-4ec1-bfd2-3e365ac86810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:17.507497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec11e8-1dea-4ec1-bfd2-3e365ac86810 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:17.521283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 343/691] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 07:12:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:17.557741 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dcae6-be71-49f5-a1cb-f7bf1c89b750 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:17.558413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dcae6-be71-49f5-a1cb-f7bf1c89b750 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:17.558413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dcae6-be71-49f5-a1cb-f7bf1c89b750 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:17.559633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 344/692] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:12:17.567399 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3704b-bffa-4529-a060-0025ccb551bc None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:17.567695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3704b-bffa-4529-a060-0025ccb551bc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:17.567939 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3704b-bffa-4529-a060-0025ccb551bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:17.590353 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0ec3704b-bffa-4529-a060-0025ccb551bc None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:17.590353 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0ec3704b-bffa-4529-a060-0025ccb551bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:17.635625 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0669b0f-8e1b-4564-a171-5b1d4f951da3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:17.673220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 345/693] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:12:17.711524 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380f2ec-0a2e-4ee4-a10d-885160ef1e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:17.712148 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380f2ec-0a2e-4ee4-a10d-885160ef1e78 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:17.712430 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380f2ec-0a2e-4ee4-a10d-885160ef1e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:17.712701 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380f2ec-0a2e-4ee4-a10d-885160ef1e78 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:17.713376 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380f2ec-0a2e-4ee4-a10d-885160ef1e78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:17.713676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380f2ec-0a2e-4ee4-a10d-885160ef1e78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:17.715360 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380f2ec-0a2e-4ee4-a10d-885160ef1e78 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:17.740730 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 349/694] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:17.746419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3704b-bffa-4529-a060-0025ccb551bc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:17.796815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:17.859579 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3704b-bffa-4529-a060-0025ccb551bc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:17.899363 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faddcb-cc19-4b5b-8923-5011648e609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:17.900006 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faddcb-cc19-4b5b-8923-5011648e609d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:17.900285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faddcb-cc19-4b5b-8923-5011648e609d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:17.900556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13faddcb-cc19-4b5b-8923-5011648e609d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:17.908278 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13faddcb-cc19-4b5b-8923-5011648e609d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:17.909728 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13faddcb-cc19-4b5b-8923-5011648e609d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-13faddcb-cc19-4b5b-8923-5011648e609d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:17.926022 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:17.926922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:17.927792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:17.927792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:17.927792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:17.927792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:17.927792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:17.927792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:17.927792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:17.927792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:17.927792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 346/695] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:17.933140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380f2ec-0a2e-4ee4-a10d-885160ef1e78 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:17.979804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faddcb-cc19-4b5b-8923-5011648e609d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:17.993607 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:18.093856 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380f2ec-0a2e-4ee4-a10d-885160ef1e78 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:18.171310 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13faddcb-cc19-4b5b-8923-5011648e609d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:18.175749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:18.177397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef1fe9-1e3f-4a6f-a185-796307568685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:18.177397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1fe9-1e3f-4a6f-a185-796307568685 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:18.177635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1fe9-1e3f-4a6f-a185-796307568685 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:18.177897 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef1fe9-1e3f-4a6f-a185-796307568685 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:18.178726 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef1fe9-1e3f-4a6f-a185-796307568685 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:18.179097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef1fe9-1e3f-4a6f-a185-796307568685 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:18.180615 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef1fe9-1e3f-4a6f-a185-796307568685 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:18.210127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 350/696] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:18.218270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef1fe9-1e3f-4a6f-a185-796307568685 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:18.218565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc179f2-4e52-48af-98c9-9121c72bfa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:18.220114 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc179f2-4e52-48af-98c9-9121c72bfa21 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:18.220578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc179f2-4e52-48af-98c9-9121c72bfa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:18.221026 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc179f2-4e52-48af-98c9-9121c72bfa21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:18.232671 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc179f2-4e52-48af-98c9-9121c72bfa21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2fc179f2-4e52-48af-98c9-9121c72bfa21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:18.237868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:18.238834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:18.239668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:18.242493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 347/697] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:18.251544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc179f2-4e52-48af-98c9-9121c72bfa21 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:18.377337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc179f2-4e52-48af-98c9-9121c72bfa21 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:18.421510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c3536-69eb-409b-9f51-67202492f729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:18.422137 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3536-69eb-409b-9f51-67202492f729 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:18.422469 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3536-69eb-409b-9f51-67202492f729 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:18.425039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3536-69eb-409b-9f51-67202492f729 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:18.425720 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c3536-69eb-409b-9f51-67202492f729 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:18.426018 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c3536-69eb-409b-9f51-67202492f729 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:18.427402 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c3536-69eb-409b-9f51-67202492f729 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:18.438920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:18.441710 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef1fe9-1e3f-4a6f-a185-796307568685 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:18.449397 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 348/698] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:12:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:18.460048 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c3536-69eb-409b-9f51-67202492f729 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:18.504888 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18df6640-2f48-4e84-b0ef-e310311780c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:18.505489 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df6640-2f48-4e84-b0ef-e310311780c7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:18.505827 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df6640-2f48-4e84-b0ef-e310311780c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:18.505948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:18.506149 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18df6640-2f48-4e84-b0ef-e310311780c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:18.506844 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df6640-2f48-4e84-b0ef-e310311780c7 None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=b115a3ce93804ddbaf542934addb506b) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:18.507148 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df6640-2f48-4e84-b0ef-e310311780c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:18.508580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18df6640-2f48-4e84-b0ef-e310311780c7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:18.527664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 351/699] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:18 2022] GET /identity/v3/role_assignments?user.id=b115a3ce93804ddbaf542934addb506b&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:18.623556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c3536-69eb-409b-9f51-67202492f729 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:18.674918 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebe93f-c339-4bac-aac3-bdb9d507dd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:18.675558 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebe93f-c339-4bac-aac3-bdb9d507dd86 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:18.675835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebe93f-c339-4bac-aac3-bdb9d507dd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:18.676101 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ebe93f-c339-4bac-aac3-bdb9d507dd86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:18.690700 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebe93f-c339-4bac-aac3-bdb9d507dd86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:18.692273 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ebe93f-c339-4bac-aac3-bdb9d507dd86 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:18.709625 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356647-6380-4e98-a849-39bdb59ae98a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:18.709962 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356647-6380-4e98-a849-39bdb59ae98a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:18.710204 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356647-6380-4e98-a849-39bdb59ae98a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:18.711549 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 352/700] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-52ebe93f-c339-4bac-aac3-bdb9d507dd86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:18.717256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:18.718272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:18.719770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:18.719770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:18.719770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:18.719952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0c519-58e7-4e2a-be40-224d2c165455 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:18.719952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0c519-58e7-4e2a-be40-224d2c165455 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:18.719952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0c519-58e7-4e2a-be40-224d2c165455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:18.720145 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 349/701] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:18.727104 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebe93f-c339-4bac-aac3-bdb9d507dd86 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:18.743244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4de0c519-58e7-4e2a-be40-224d2c165455 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:18.744814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4de0c519-58e7-4e2a-be40-224d2c165455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:18.851190 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 353/702] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:12:18.864050 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:18.891989 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ebe93f-c339-4bac-aac3-bdb9d507dd86 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:18.931141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6a80c-e3f8-403c-a8a6-04603918c49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:18.932003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a80c-e3f8-403c-a8a6-04603918c49c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:18.932434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a80c-e3f8-403c-a8a6-04603918c49c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:18.932869 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6a80c-e3f8-403c-a8a6-04603918c49c None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:18.933660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6a80c-e3f8-403c-a8a6-04603918c49c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:18.934147 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6a80c-e3f8-403c-a8a6-04603918c49c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:18.935797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6a80c-e3f8-403c-a8a6-04603918c49c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:18.954446 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 350/703] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:18.959208 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0c519-58e7-4e2a-be40-224d2c165455 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:19.061493 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:19.069471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0c519-58e7-4e2a-be40-224d2c165455 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:19.080571 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de689fcf-9e2e-42fd-870b-6a403f0491ea None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:19.080914 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de689fcf-9e2e-42fd-870b-6a403f0491ea None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:19.081192 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de689fcf-9e2e-42fd-870b-6a403f0491ea None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:19.082823 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 351/704] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:19.089283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3daeb-e26d-4181-a43c-5c11df2a3e57 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:19.089573 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3daeb-e26d-4181-a43c-5c11df2a3e57 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:19.089847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3daeb-e26d-4181-a43c-5c11df2a3e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:19.113790 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb62e77-a129-42f1-be2d-75c45f59fde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:19.114455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb62e77-a129-42f1-be2d-75c45f59fde9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:19.114736 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb62e77-a129-42f1-be2d-75c45f59fde9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:19.115009 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb62e77-a129-42f1-be2d-75c45f59fde9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:19.122060 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-bda3daeb-e26d-4181-a43c-5c11df2a3e57 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:19.123541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb62e77-a129-42f1-be2d-75c45f59fde9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:19.124076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-bda3daeb-e26d-4181-a43c-5c11df2a3e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:19.125047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb62e77-a129-42f1-be2d-75c45f59fde9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6bb62e77-a129-42f1-be2d-75c45f59fde9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:19.143455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:19.144487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:19.145444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:19.145444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:19.145444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:19.145444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:19.145444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:19.145444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:19.145444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:19.145444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:19.145444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:12:19.145444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:19.145444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 354/705] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 07:12:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:19.151095 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb62e77-a129-42f1-be2d-75c45f59fde9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:19.206541 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 352/706] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:19.207774 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3daeb-e26d-4181-a43c-5c11df2a3e57 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:19.266126 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb62e77-a129-42f1-be2d-75c45f59fde9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:19.301840 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f368db-572d-444a-a8ea-5e9992204a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:19.302048 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f368db-572d-444a-a8ea-5e9992204a6d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:19.302313 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f368db-572d-444a-a8ea-5e9992204a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:19.302855 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f368db-572d-444a-a8ea-5e9992204a6d None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:19.303591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f368db-572d-444a-a8ea-5e9992204a6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:19.303894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f368db-572d-444a-a8ea-5e9992204a6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:19.305326 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f368db-572d-444a-a8ea-5e9992204a6d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:19.324561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 355/707] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 07:12:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:19.330402 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f368db-572d-444a-a8ea-5e9992204a6d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:19.347832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:19.348298 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:19.438744 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f368db-572d-444a-a8ea-5e9992204a6d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:19.456619 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3daeb-e26d-4181-a43c-5c11df2a3e57 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:19.477637 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d7a55-c4f0-437d-8a4f-ef4e6208ea46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:19.478355 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7a55-c4f0-437d-8a4f-ef4e6208ea46 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:19.478549 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7a55-c4f0-437d-8a4f-ef4e6208ea46 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:19.479123 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d7a55-c4f0-437d-8a4f-ef4e6208ea46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:19.555627 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d7a55-c4f0-437d-8a4f-ef4e6208ea46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:19.557272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43d7a55-c4f0-437d-8a4f-ef4e6208ea46 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:19.561291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d52ad-d92d-42fd-98af-f3b96591b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:19.562236 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d52ad-d92d-42fd-98af-f3b96591b8ae None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:19.562694 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d52ad-d92d-42fd-98af-f3b96591b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:19.563199 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d52ad-d92d-42fd-98af-f3b96591b8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:19.573985 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:19.575856 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d52ad-d92d-42fd-98af-f3b96591b8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:19.577505 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d52ad-d92d-42fd-98af-f3b96591b8ae None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-b37d52ad-d92d-42fd-98af-f3b96591b8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:19.597076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:19.598081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:19.599176 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:19.599176 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:19.599176 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:19.601238 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 353/708] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:19.602354 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d52ad-d92d-42fd-98af-f3b96591b8ae None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:19.690555 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 356/709] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:19.691560 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d7a55-c4f0-437d-8a4f-ef4e6208ea46 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:19.741408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d52ad-d92d-42fd-98af-f3b96591b8ae None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:19.769119 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:19.789559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3313354-8c9a-46e7-ace6-e3cae15280a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:19.790227 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3313354-8c9a-46e7-ace6-e3cae15280a2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:19.790502 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3313354-8c9a-46e7-ace6-e3cae15280a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:19.790770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3313354-8c9a-46e7-ace6-e3cae15280a2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:19.791345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3313354-8c9a-46e7-ace6-e3cae15280a2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:19.792702 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3313354-8c9a-46e7-ace6-e3cae15280a2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a3313354-8c9a-46e7-ace6-e3cae15280a2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:19.801767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:19.802792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:19.803616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 354/710] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:19 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:19.804415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3313354-8c9a-46e7-ace6-e3cae15280a2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:19.811084 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43d7a55-c4f0-437d-8a4f-ef4e6208ea46 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:19.825588 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:19.847815 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c933af-77fb-4759-871f-74f818cd9cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:19.848523 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c933af-77fb-4759-871f-74f818cd9cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:19.848794 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c933af-77fb-4759-871f-74f818cd9cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:19.849062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c933af-77fb-4759-871f-74f818cd9cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:19.849696 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c933af-77fb-4759-871f-74f818cd9cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:19.849990 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c933af-77fb-4759-871f-74f818cd9cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:19.851483 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c933af-77fb-4759-871f-74f818cd9cd9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:19.868543 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 357/711] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:19.868543 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9137-5e28-48f4-bebe-9f2c4309faf0 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:19.868543 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9137-5e28-48f4-bebe-9f2c4309faf0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:19.868543 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d9137-5e28-48f4-bebe-9f2c4309faf0 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:19.868543 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 358/712] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:19.868543 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d9137-5e28-48f4-bebe-9f2c4309faf0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:19.918446 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3313354-8c9a-46e7-ace6-e3cae15280a2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:19.955171 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5167c7d-dc1e-4ec1-9ee8-9f80e26f8bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:19.955763 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5167c7d-dc1e-4ec1-9ee8-9f80e26f8bbc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:19.956044 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5167c7d-dc1e-4ec1-9ee8-9f80e26f8bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:19.956312 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5167c7d-dc1e-4ec1-9ee8-9f80e26f8bbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:19.966454 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5167c7d-dc1e-4ec1-9ee8-9f80e26f8bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:19.967957 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5167c7d-dc1e-4ec1-9ee8-9f80e26f8bbc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:19.977140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d9137-5e28-48f4-bebe-9f2c4309faf0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c5167c7d-dc1e-4ec1-9ee8-9f80e26f8bbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:19.982601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:19.983510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:19.984373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:19.984373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:19.984373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:19.984373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 355/713] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:19.984713 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5167c7d-dc1e-4ec1-9ee8-9f80e26f8bbc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:20.017915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3148a-f1a1-4032-9cd9-25af75f32581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:20.018825 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3148a-f1a1-4032-9cd9-25af75f32581 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:20.019103 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3148a-f1a1-4032-9cd9-25af75f32581 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:20.019374 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3148a-f1a1-4032-9cd9-25af75f32581 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:20.020000 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3148a-f1a1-4032-9cd9-25af75f32581 None admin] RBAC: Adding query filter params (name=network) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:20.020297 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3148a-f1a1-4032-9cd9-25af75f32581 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:20.021773 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3148a-f1a1-4032-9cd9-25af75f32581 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:20.022249 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:20.031402 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 359/714] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:20.031402 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e5d79-c99d-4997-a699-f725b94efa02 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:20.031402 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e5d79-c99d-4997-a699-f725b94efa02 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:20.031402 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e5d79-c99d-4997-a699-f725b94efa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:20.046815 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-a84e5d79-c99d-4997-a699-f725b94efa02 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:20.048202 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-a84e5d79-c99d-4997-a699-f725b94efa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:20.080352 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:20.093554 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5167c7d-dc1e-4ec1-9ee8-9f80e26f8bbc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:20.122267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 360/715] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:20.122267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e5d79-c99d-4997-a699-f725b94efa02 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:20.137112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a4855-202d-4bde-9880-2143be07663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:20.138006 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a4855-202d-4bde-9880-2143be07663c None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:20.138310 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a4855-202d-4bde-9880-2143be07663c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:20.138584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a4855-202d-4bde-9880-2143be07663c None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:20.139234 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a4855-202d-4bde-9880-2143be07663c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:20.140716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a4855-202d-4bde-9880-2143be07663c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:20.218134 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 356/716] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:12:19 2022] POST /identity/v3/users => generated 254 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:20.218134 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a4855-202d-4bde-9880-2143be07663c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:20.268581 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e5d79-c99d-4997-a699-f725b94efa02 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:20.340988 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a15e3-8843-434f-87ca-38cd06baefc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:20.341603 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a15e3-8843-434f-87ca-38cd06baefc4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:20.341885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a15e3-8843-434f-87ca-38cd06baefc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:20.342182 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a15e3-8843-434f-87ca-38cd06baefc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:20.342843 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a15e3-8843-434f-87ca-38cd06baefc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:20.343146 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a15e3-8843-434f-87ca-38cd06baefc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:20.344586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a15e3-8843-434f-87ca-38cd06baefc4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:20.369447 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 361/717] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:20.374637 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a15e3-8843-434f-87ca-38cd06baefc4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:20.399398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:20.413305 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a4855-202d-4bde-9880-2143be07663c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:20.420543 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:20.457584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e5cc6-31bc-4b74-b988-43b285c4c163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:20.458245 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e5cc6-31bc-4b74-b988-43b285c4c163 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:20.458526 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e5cc6-31bc-4b74-b988-43b285c4c163 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:20.458821 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e5cc6-31bc-4b74-b988-43b285c4c163 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:20.459454 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e5cc6-31bc-4b74-b988-43b285c4c163 None admin] RBAC: Adding query filter params (type=network) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:20.459754 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e5cc6-31bc-4b74-b988-43b285c4c163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:20.461149 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e5cc6-31bc-4b74-b988-43b285c4c163 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:20.467716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 357/718] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:20.471491 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e5cc6-31bc-4b74-b988-43b285c4c163 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:20.520241 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a15e3-8843-434f-87ca-38cd06baefc4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:20.571034 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0e53d-9490-431c-8b0b-f4f1611b97f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:20.571681 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0e53d-9490-431c-8b0b-f4f1611b97f5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:20.571964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0e53d-9490-431c-8b0b-f4f1611b97f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:20.572236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0e53d-9490-431c-8b0b-f4f1611b97f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:20.583759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0e53d-9490-431c-8b0b-f4f1611b97f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:20.585233 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0e53d-9490-431c-8b0b-f4f1611b97f5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-dca0e53d-9490-431c-8b0b-f4f1611b97f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:20.602428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:20.603346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:20.604214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:20.604214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:20.604214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:20.604214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:20.604214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:20.604214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:20.604214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:20.604214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:20.604631 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 362/719] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:20.609067 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e5cc6-31bc-4b74-b988-43b285c4c163 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:20.612450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0e53d-9490-431c-8b0b-f4f1611b97f5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:20.660959 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94926eb0-601e-4bb2-b3f0-2586b058dc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:20.662588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926eb0-601e-4bb2-b3f0-2586b058dc52 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:20.664325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926eb0-601e-4bb2-b3f0-2586b058dc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:20.665031 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94926eb0-601e-4bb2-b3f0-2586b058dc52 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:20.666236 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94926eb0-601e-4bb2-b3f0-2586b058dc52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:20.668782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94926eb0-601e-4bb2-b3f0-2586b058dc52 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:20.739405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:20.756197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0e53d-9490-431c-8b0b-f4f1611b97f5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:20.782258 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 358/720] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:12:20 2022] POST /identity/v3/services => generated 251 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:20.826187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42fcb71-fede-45e3-b9ed-558e7e4cf879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:20.826898 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fcb71-fede-45e3-b9ed-558e7e4cf879 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:20.827178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fcb71-fede-45e3-b9ed-558e7e4cf879 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:20.827444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42fcb71-fede-45e3-b9ed-558e7e4cf879 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:20.828138 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fcb71-fede-45e3-b9ed-558e7e4cf879 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:20.829449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fcb71-fede-45e3-b9ed-558e7e4cf879 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:20.831124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42fcb71-fede-45e3-b9ed-558e7e4cf879 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:20.849798 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 363/721] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:20.855968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94926eb0-601e-4bb2-b3f0-2586b058dc52 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:20.879218 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:20.985835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94926eb0-601e-4bb2-b3f0-2586b058dc52 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:21.022698 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e9f57-70ff-4d2b-a240-36c918ef43ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:21.023311 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e9f57-70ff-4d2b-a240-36c918ef43ec None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:21.023591 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e9f57-70ff-4d2b-a240-36c918ef43ec None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:21.023864 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e9f57-70ff-4d2b-a240-36c918ef43ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:21.024594 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e9f57-70ff-4d2b-a240-36c918ef43ec None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=bb99f54d9320496cbcc52d535fa64789) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:21.024901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e9f57-70ff-4d2b-a240-36c918ef43ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:21.026419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e9f57-70ff-4d2b-a240-36c918ef43ec None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:21.033135 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 359/722] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:20 2022] GET /identity/v3/role_assignments?user.id=bb99f54d9320496cbcc52d535fa64789&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=afe88bc03d30494b89892587177c79de => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:21.068008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ea746-5db2-44f7-875c-cae5c45a02d9 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:21.068326 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ea746-5db2-44f7-875c-cae5c45a02d9 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:21.068559 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ea746-5db2-44f7-875c-cae5c45a02d9 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:21.070377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 364/723] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:21.076367 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfc4f-edc8-4a5d-9e4c-82ed158be39c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:21.076655 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfc4f-edc8-4a5d-9e4c-82ed158be39c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:21.076937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddfc4f-edc8-4a5d-9e4c-82ed158be39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:21.098152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-dbddfc4f-edc8-4a5d-9e4c-82ed158be39c None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:21.099356 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dbddfc4f-edc8-4a5d-9e4c-82ed158be39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:21.181942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 360/724] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:21.562594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ea746-5db2-44f7-875c-cae5c45a02d9 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:21.682696 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ea746-5db2-44f7-875c-cae5c45a02d9 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:21.720666 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad749d-53f1-44ab-afaa-965bf7ed1d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:21.721355 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad749d-53f1-44ab-afaa-965bf7ed1d58 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:21.721648 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad749d-53f1-44ab-afaa-965bf7ed1d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:21.721916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad749d-53f1-44ab-afaa-965bf7ed1d58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:21.733403 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad749d-53f1-44ab-afaa-965bf7ed1d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e0ad749d-53f1-44ab-afaa-965bf7ed1d58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:21.739030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:21.739964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:21.740775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 365/725] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:21.746646 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddfc4f-edc8-4a5d-9e4c-82ed158be39c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:21.770689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:21.907822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddfc4f-edc8-4a5d-9e4c-82ed158be39c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:21.952300 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3f820-cb1b-464a-bc91-8e0ee332d41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:21.952908 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3f820-cb1b-464a-bc91-8e0ee332d41a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:21.953180 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3f820-cb1b-464a-bc91-8e0ee332d41a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:21.954025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3f820-cb1b-464a-bc91-8e0ee332d41a None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:21.954712 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3f820-cb1b-464a-bc91-8e0ee332d41a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:21.955013 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3f820-cb1b-464a-bc91-8e0ee332d41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:21.956387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3f820-cb1b-464a-bc91-8e0ee332d41a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:21.970473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 361/726] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:12:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:21.976439 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad749d-53f1-44ab-afaa-965bf7ed1d58 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:21.979798 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:22.092473 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad749d-53f1-44ab-afaa-965bf7ed1d58 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:22.128507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de34468-9933-417d-8ec9-06313f59508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:22.129131 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de34468-9933-417d-8ec9-06313f59508b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:22.129399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de34468-9933-417d-8ec9-06313f59508b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:22.129666 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de34468-9933-417d-8ec9-06313f59508b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:22.141664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de34468-9933-417d-8ec9-06313f59508b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:22.143141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de34468-9933-417d-8ec9-06313f59508b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8de34468-9933-417d-8ec9-06313f59508b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:22.159679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:22.160651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:22.161550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:22.161550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:22.161550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:22.161550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 366/727] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:22.167117 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3f820-cb1b-464a-bc91-8e0ee332d41a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:22.250689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:22.295403 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3f820-cb1b-464a-bc91-8e0ee332d41a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:22.343587 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fe945-a4da-4872-b07b-30de18a8fd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:22.344954 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fe945-a4da-4872-b07b-30de18a8fd6e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:22.345229 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fe945-a4da-4872-b07b-30de18a8fd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:22.345493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fe945-a4da-4872-b07b-30de18a8fd6e None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:22.346158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fe945-a4da-4872-b07b-30de18a8fd6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:22.346457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fe945-a4da-4872-b07b-30de18a8fd6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:22.347819 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fe945-a4da-4872-b07b-30de18a8fd6e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:22.367763 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de34468-9933-417d-8ec9-06313f59508b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:22.378835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 362/728] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:22.428437 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:22.488106 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de34468-9933-417d-8ec9-06313f59508b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:22.524532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fca9b1-1094-4700-a0ab-e9212d46f9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:22.525179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca9b1-1094-4700-a0ab-e9212d46f9ae None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:22.525453 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca9b1-1094-4700-a0ab-e9212d46f9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:22.525724 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fca9b1-1094-4700-a0ab-e9212d46f9ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:22.535004 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fca9b1-1094-4700-a0ab-e9212d46f9ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:22.536451 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fca9b1-1094-4700-a0ab-e9212d46f9ae None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-64fca9b1-1094-4700-a0ab-e9212d46f9ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:22.548697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:22.549644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:22.550628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:22.550628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:22.550628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:22.550628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:22.550628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:22.550628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:22.550628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:22.550628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:22.550628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:22.550628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:22.554422 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 367/729] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:22.555913 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fe945-a4da-4872-b07b-30de18a8fd6e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:22.693400 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fe945-a4da-4872-b07b-30de18a8fd6e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:22.736109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:22.746929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d844b7-06f7-4575-a914-d17c6d8806d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:22.747543 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d844b7-06f7-4575-a914-d17c6d8806d7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:22.747824 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d844b7-06f7-4575-a914-d17c6d8806d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:22.748096 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d844b7-06f7-4575-a914-d17c6d8806d7 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:22.748822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d844b7-06f7-4575-a914-d17c6d8806d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:22.764247 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d844b7-06f7-4575-a914-d17c6d8806d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:22.764247 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d844b7-06f7-4575-a914-d17c6d8806d7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:22.772118 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 363/730] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 07:12:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:22.778412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fca9b1-1094-4700-a0ab-e9212d46f9ae None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:22.885639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fca9b1-1094-4700-a0ab-e9212d46f9ae None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:22.902697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:22.920510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329af30-3e46-4937-90ab-3926e150fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:22.921110 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329af30-3e46-4937-90ab-3926e150fb87 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:22.921384 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329af30-3e46-4937-90ab-3926e150fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:22.921651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329af30-3e46-4937-90ab-3926e150fb87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:22.991273 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd121e9-b9fb-4c70-a9e6-e00e17a527d4 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:22.991761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd121e9-b9fb-4c70-a9e6-e00e17a527d4 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:22.991761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd121e9-b9fb-4c70-a9e6-e00e17a527d4 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:22.992736 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329af30-3e46-4937-90ab-3926e150fb87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:22.994211 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329af30-3e46-4937-90ab-3926e150fb87 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:22.997097 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 364/731] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:12:22.998850 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503b6de-622b-45ce-9c3b-1301e4aa126d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:22.999208 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503b6de-622b-45ce-9c3b-1301e4aa126d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:22.999558 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503b6de-622b-45ce-9c3b-1301e4aa126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:23.021963 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4503b6de-622b-45ce-9c3b-1301e4aa126d None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:23.023864 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4503b6de-622b-45ce-9c3b-1301e4aa126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:23.110775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 368/733] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:22 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 07:12:23.110973 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 365/733] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 07:12:23.112286 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602297-109e-4ec4-838a-894e12947f8d None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:23.112620 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602297-109e-4ec4-838a-894e12947f8d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:23.112894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8602297-109e-4ec4-838a-894e12947f8d None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:23.114539 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 369/734] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:23.117213 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503b6de-622b-45ce-9c3b-1301e4aa126d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:23.120990 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88677-81ea-49b6-9a54-0d500f7cf905 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:23.121320 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88677-81ea-49b6-9a54-0d500f7cf905 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:23.121598 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b88677-81ea-49b6-9a54-0d500f7cf905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:23.139829 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-b4b88677-81ea-49b6-9a54-0d500f7cf905 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:23.141087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-b4b88677-81ea-49b6-9a54-0d500f7cf905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:23.151169 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:23.225126 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 370/735] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 07:12:23.295513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503b6de-622b-45ce-9c3b-1301e4aa126d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:23.322856 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:23.342196 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d482c8-a3d4-4683-a721-1cf5232c3900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:23.342875 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d482c8-a3d4-4683-a721-1cf5232c3900 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:23.343154 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d482c8-a3d4-4683-a721-1cf5232c3900 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:23.343424 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d482c8-a3d4-4683-a721-1cf5232c3900 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:23.358357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d482c8-a3d4-4683-a721-1cf5232c3900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:23.360038 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d482c8-a3d4-4683-a721-1cf5232c3900 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-93d482c8-a3d4-4683-a721-1cf5232c3900 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:23.379588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:23.380545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:23.381434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:23.381434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:23.381434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:23.381434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 366/736] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:23.387731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88677-81ea-49b6-9a54-0d500f7cf905 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:23.422563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d482c8-a3d4-4683-a721-1cf5232c3900 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:23.548410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d482c8-a3d4-4683-a721-1cf5232c3900 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:23.575298 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b88677-81ea-49b6-9a54-0d500f7cf905 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:23.616667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfbbb7-c19a-4b38-8ad9-4edbdc227d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:23.617319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfbbb7-c19a-4b38-8ad9-4edbdc227d3a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:23.617598 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfbbb7-c19a-4b38-8ad9-4edbdc227d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:23.617867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfbbb7-c19a-4b38-8ad9-4edbdc227d3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:23.621907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9df99-3aad-4bd8-bf9f-dc9f46bcca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:23.622621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9df99-3aad-4bd8-bf9f-dc9f46bcca01 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:23.622899 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9df99-3aad-4bd8-bf9f-dc9f46bcca01 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:23.623316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9df99-3aad-4bd8-bf9f-dc9f46bcca01 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:23.624159 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9df99-3aad-4bd8-bf9f-dc9f46bcca01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:23.624413 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9df99-3aad-4bd8-bf9f-dc9f46bcca01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:23.626603 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9df99-3aad-4bd8-bf9f-dc9f46bcca01 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:23.629129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfbbb7-c19a-4b38-8ad9-4edbdc227d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-4adfbbb7-c19a-4b38-8ad9-4edbdc227d3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:23.634612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:23.635664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:23.636515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 367/737] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:23.637223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfbbb7-c19a-4b38-8ad9-4edbdc227d3a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:23.640095 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 371/738] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:23.642231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c8792-1f27-4ad2-82b0-724720c34f7e None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:23.642610 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c8792-1f27-4ad2-82b0-724720c34f7e None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:23.642943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c8792-1f27-4ad2-82b0-724720c34f7e None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:23.644237 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 372/739] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:23.646829 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c8792-1f27-4ad2-82b0-724720c34f7e None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:23.650800 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:23.672310 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:23.747286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfbbb7-c19a-4b38-8ad9-4edbdc227d3a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:23.755559 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c8792-1f27-4ad2-82b0-724720c34f7e None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:23.781417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520f9b6-ba6d-4e04-934f-11bab11859f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:23.782251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520f9b6-ba6d-4e04-934f-11bab11859f4 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:23.782527 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520f9b6-ba6d-4e04-934f-11bab11859f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:23.782796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520f9b6-ba6d-4e04-934f-11bab11859f4 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:23.783448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520f9b6-ba6d-4e04-934f-11bab11859f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:23.784799 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520f9b6-ba6d-4e04-934f-11bab11859f4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:23.789289 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a05e81-c42f-4c13-a3c4-21eb3ece1bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:23.789885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a05e81-c42f-4c13-a3c4-21eb3ece1bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:23.790196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a05e81-c42f-4c13-a3c4-21eb3ece1bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:23.790469 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a05e81-c42f-4c13-a3c4-21eb3ece1bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:23.791132 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a05e81-c42f-4c13-a3c4-21eb3ece1bb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:23.791430 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a05e81-c42f-4c13-a3c4-21eb3ece1bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:23.792775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a05e81-c42f-4c13-a3c4-21eb3ece1bb5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:23.804546 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 373/740] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:23.804546 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a05e81-c42f-4c13-a3c4-21eb3ece1bb5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:23.832601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 368/741] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:12:23 2022] POST /identity/v3/services => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:23.833895 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3ac1-9620-417b-9f63-fedc7db88d6c None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:23.834217 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3ac1-9620-417b-9f63-fedc7db88d6c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:23.834518 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f3ac1-9620-417b-9f63-fedc7db88d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:23.859464 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-837f3ac1-9620-417b-9f63-fedc7db88d6c None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:23.860822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-837f3ac1-9620-417b-9f63-fedc7db88d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:23.873926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:23.917279 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a05e81-c42f-4c13-a3c4-21eb3ece1bb5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:23.945101 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 369/742] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:23.946436 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aaba8-0d67-4a39-8689-3c05862353bd None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:23.946724 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aaba8-0d67-4a39-8689-3c05862353bd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:23.946997 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922aaba8-0d67-4a39-8689-3c05862353bd None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:23.948494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 370/743] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:23.949020 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922aaba8-0d67-4a39-8689-3c05862353bd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:23.971631 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:23.998947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694ca02-91ad-49c4-80f1-7033db24b3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:23.999570 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694ca02-91ad-49c4-80f1-7033db24b3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:23.999849 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694ca02-91ad-49c4-80f1-7033db24b3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:24.000639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694ca02-91ad-49c4-80f1-7033db24b3b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:24.010609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694ca02-91ad-49c4-80f1-7033db24b3b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:24.012063 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694ca02-91ad-49c4-80f1-7033db24b3b7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-9694ca02-91ad-49c4-80f1-7033db24b3b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:24.025267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:24.026238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:24.027141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:24.027141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:24.027141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:24.027141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:24.027141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:24.027141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:24.027141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:24.027141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:24.027141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 374/744] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:24.028157 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb79ec-4b10-49b2-b47d-67b01d3fe72a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:24.028258 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb79ec-4b10-49b2-b47d-67b01d3fe72a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:24.028511 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fb79ec-4b10-49b2-b47d-67b01d3fe72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:24.049983 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e1fb79ec-4b10-49b2-b47d-67b01d3fe72a None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:24.051205 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e1fb79ec-4b10-49b2-b47d-67b01d3fe72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:24.079772 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922aaba8-0d67-4a39-8689-3c05862353bd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:24.128342 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6414a-7901-4fff-b428-e64a510be427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:24.129427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6414a-7901-4fff-b428-e64a510be427 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:24.129882 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6414a-7901-4fff-b428-e64a510be427 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:24.130342 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6414a-7901-4fff-b428-e64a510be427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:24.131258 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 375/745] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:24.132318 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb79ec-4b10-49b2-b47d-67b01d3fe72a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:24.143965 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6414a-7901-4fff-b428-e64a510be427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:24.146350 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6414a-7901-4fff-b428-e64a510be427 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-83e6414a-7901-4fff-b428-e64a510be427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:24.168871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:24.169838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:24.170742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:24.170742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:24.170742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:24.173728 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 371/746] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:24.180449 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6414a-7901-4fff-b428-e64a510be427 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:24.223517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:24.278786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fb79ec-4b10-49b2-b47d-67b01d3fe72a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:24.329118 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bf14d-9b81-41d3-8473-2cf9674972e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:24.330272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bf14d-9b81-41d3-8473-2cf9674972e4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:24.330500 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bf14d-9b81-41d3-8473-2cf9674972e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:24.330775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bf14d-9b81-41d3-8473-2cf9674972e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:24.331740 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bf14d-9b81-41d3-8473-2cf9674972e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:24.332063 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bf14d-9b81-41d3-8473-2cf9674972e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:24.333860 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bf14d-9b81-41d3-8473-2cf9674972e4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:24.349643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 376/747] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:24.350822 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bf14d-9b81-41d3-8473-2cf9674972e4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:24.389691 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:24.424765 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6414a-7901-4fff-b428-e64a510be427 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:24.463551 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b27b6-3108-4562-94e1-74db6a6dd65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:24.464162 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b27b6-3108-4562-94e1-74db6a6dd65a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:24.464442 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b27b6-3108-4562-94e1-74db6a6dd65a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:24.464957 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b27b6-3108-4562-94e1-74db6a6dd65a None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:24.465603 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b27b6-3108-4562-94e1-74db6a6dd65a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:24.465900 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b27b6-3108-4562-94e1-74db6a6dd65a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:24.467095 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bf14d-9b81-41d3-8473-2cf9674972e4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:24.467320 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b27b6-3108-4562-94e1-74db6a6dd65a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:24.480725 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 372/748] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:24.481535 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b27b6-3108-4562-94e1-74db6a6dd65a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:24.490489 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:24.510037 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696526-0c05-4103-a459-7738598c7d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:24.511001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696526-0c05-4103-a459-7738598c7d79 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:24.511554 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696526-0c05-4103-a459-7738598c7d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:24.511929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a696526-0c05-4103-a459-7738598c7d79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:24.523967 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a696526-0c05-4103-a459-7738598c7d79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-2a696526-0c05-4103-a459-7738598c7d79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:24.528911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:24.529871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:24.530729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 377/749] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:24.532915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696526-0c05-4103-a459-7738598c7d79 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:24.598544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b27b6-3108-4562-94e1-74db6a6dd65a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:24.632516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:24.638749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b7b7-169d-40b3-8bf6-72844a6fa64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:24.639352 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b7b7-169d-40b3-8bf6-72844a6fa64d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:24.639634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b7b7-169d-40b3-8bf6-72844a6fa64d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:24.640064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b7b7-169d-40b3-8bf6-72844a6fa64d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:24.640634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314b7b7-169d-40b3-8bf6-72844a6fa64d None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=b115a3ce93804ddbaf542934addb506b) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:24.640981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314b7b7-169d-40b3-8bf6-72844a6fa64d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:24.642429 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314b7b7-169d-40b3-8bf6-72844a6fa64d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:24.647594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a696526-0c05-4103-a459-7738598c7d79 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:24.657092 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 373/750] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:24 2022] GET /identity/v3/role_assignments?user.id=b115a3ce93804ddbaf542934addb506b&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=afe88bc03d30494b89892587177c79de => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:24.659213 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b7b7-169d-40b3-8bf6-72844a6fa64d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:24.688158 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75c08b-9a18-4031-acae-f3ae6200c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:24.688900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c08b-9a18-4031-acae-f3ae6200c127 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:24.689250 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c08b-9a18-4031-acae-f3ae6200c127 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:24.689595 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c08b-9a18-4031-acae-f3ae6200c127 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:24.690301 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75c08b-9a18-4031-acae-f3ae6200c127 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:24.692091 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75c08b-9a18-4031-acae-f3ae6200c127 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ad75c08b-9a18-4031-acae-f3ae6200c127 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:24.705412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:24.706507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:12:24.707330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:24.712011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 378/751] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 23 07:12:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:24.713731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75c08b-9a18-4031-acae-f3ae6200c127 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:24.767085 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:24.795632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b7b7-169d-40b3-8bf6-72844a6fa64d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:24.834678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb29b6f-fb65-403f-a306-e6af1e661210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:24.835375 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb29b6f-fb65-403f-a306-e6af1e661210 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:24.835595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb29b6f-fb65-403f-a306-e6af1e661210 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:24.835865 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb29b6f-fb65-403f-a306-e6af1e661210 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:24.843748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb29b6f-fb65-403f-a306-e6af1e661210 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:24.845780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb29b6f-fb65-403f-a306-e6af1e661210 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:24.849256 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75c08b-9a18-4031-acae-f3ae6200c127 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3cb29b6f-fb65-403f-a306-e6af1e661210 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:24.858377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:24.859831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:24.861040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:24.861040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:24.861040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:24.861040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:24.861040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:24.861040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:24.861040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:24.861040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:24.861040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:24.861040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:24.861040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 374/752] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 07:12:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:24.861636 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb29b6f-fb65-403f-a306-e6af1e661210 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:24.895270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a09b53-950b-4ee1-933c-4f272949b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:24.895916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09b53-950b-4ee1-933c-4f272949b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:24.896205 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09b53-950b-4ee1-933c-4f272949b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:24.896483 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a09b53-950b-4ee1-933c-4f272949b3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:24.897423 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a09b53-950b-4ee1-933c-4f272949b3d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:24.897729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a09b53-950b-4ee1-933c-4f272949b3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:24.899958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a09b53-950b-4ee1-933c-4f272949b3d1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:24.918183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 379/753] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:24.919377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a09b53-950b-4ee1-933c-4f272949b3d1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:24.934734 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:24.983376 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb29b6f-fb65-403f-a306-e6af1e661210 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:25.020749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5a5c5-c2b6-43d1-88fc-375d575dba9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:25.021199 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5a5c5-c2b6-43d1-88fc-375d575dba9f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:25.021475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5a5c5-c2b6-43d1-88fc-375d575dba9f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:25.021782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5a5c5-c2b6-43d1-88fc-375d575dba9f None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:25.022455 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5a5c5-c2b6-43d1-88fc-375d575dba9f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:25.022751 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5a5c5-c2b6-43d1-88fc-375d575dba9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:25.024107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5a5c5-c2b6-43d1-88fc-375d575dba9f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:25.028690 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 375/754] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 07:12:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:25.029466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5a5c5-c2b6-43d1-88fc-375d575dba9f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:25.076657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a09b53-950b-4ee1-933c-4f272949b3d1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:25.079437 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:25.123261 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56600d-ba11-4e00-8ffb-b0a6bbd23b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:25.124383 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56600d-ba11-4e00-8ffb-b0a6bbd23b99 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:25.124817 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56600d-ba11-4e00-8ffb-b0a6bbd23b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:25.126444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56600d-ba11-4e00-8ffb-b0a6bbd23b99 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:25.127350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56600d-ba11-4e00-8ffb-b0a6bbd23b99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:25.128308 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56600d-ba11-4e00-8ffb-b0a6bbd23b99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:25.130201 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56600d-ba11-4e00-8ffb-b0a6bbd23b99 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:25.141415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5a5c5-c2b6-43d1-88fc-375d575dba9f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:25.154771 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 380/755] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 07:12:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:25.155970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56600d-ba11-4e00-8ffb-b0a6bbd23b99 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:25.160045 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:25.179740 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9efe60-023c-4cbe-9301-e4277f4c2a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:25.180624 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9efe60-023c-4cbe-9301-e4277f4c2a5d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:25.180903 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9efe60-023c-4cbe-9301-e4277f4c2a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:25.181236 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9efe60-023c-4cbe-9301-e4277f4c2a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:25.194135 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9efe60-023c-4cbe-9301-e4277f4c2a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:25.195733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9efe60-023c-4cbe-9301-e4277f4c2a5d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1e9efe60-023c-4cbe-9301-e4277f4c2a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:25.210487 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:25.211657 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:25.212788 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:25.212788 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:25.212788 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:25.213325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 376/756] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:25.214231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9efe60-023c-4cbe-9301-e4277f4c2a5d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:25.277688 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56600d-ba11-4e00-8ffb-b0a6bbd23b99 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:25.317788 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96935aff-5cc2-463e-810d-fb7bedc6e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:25.318617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96935aff-5cc2-463e-810d-fb7bedc6e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:25.318865 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96935aff-5cc2-463e-810d-fb7bedc6e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:25.319200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96935aff-5cc2-463e-810d-fb7bedc6e6a3 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:25.319896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96935aff-5cc2-463e-810d-fb7bedc6e6a3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:25.320356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96935aff-5cc2-463e-810d-fb7bedc6e6a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:25.321947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96935aff-5cc2-463e-810d-fb7bedc6e6a3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:25.327429 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9efe60-023c-4cbe-9301-e4277f4c2a5d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:25.328777 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 381/757] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 07:12:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:25.329882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96935aff-5cc2-463e-810d-fb7bedc6e6a3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:25.357803 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:25.366604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd701d68-b050-4f0a-9544-a494106af276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:25.367389 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd701d68-b050-4f0a-9544-a494106af276 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:25.369373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd701d68-b050-4f0a-9544-a494106af276 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:25.369373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd701d68-b050-4f0a-9544-a494106af276 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:25.412752 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:25.442570 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96935aff-5cc2-463e-810d-fb7bedc6e6a3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:25.444964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd701d68-b050-4f0a-9544-a494106af276 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:25.446606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd701d68-b050-4f0a-9544-a494106af276 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:25.480338 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d6161-8e9b-49a0-bd2b-4ff7e2410ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:25.480958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d6161-8e9b-49a0-bd2b-4ff7e2410ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:25.481236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d6161-8e9b-49a0-bd2b-4ff7e2410ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:25.481503 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d6161-8e9b-49a0-bd2b-4ff7e2410ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:25.482185 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d6161-8e9b-49a0-bd2b-4ff7e2410ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:25.482489 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d6161-8e9b-49a0-bd2b-4ff7e2410ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:25.484569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d6161-8e9b-49a0-bd2b-4ff7e2410ed8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:25.496884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 382/758] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:25.497714 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d6161-8e9b-49a0-bd2b-4ff7e2410ed8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:25.556364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 377/759] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:12:25.557595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd701d68-b050-4f0a-9544-a494106af276 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:25.591248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:25.608142 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d6161-8e9b-49a0-bd2b-4ff7e2410ed8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:25.636169 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:25.648164 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c0c8d-6d88-4ff4-b5ca-934af28ddedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:25.648810 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c0c8d-6d88-4ff4-b5ca-934af28ddedf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:25.649168 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c0c8d-6d88-4ff4-b5ca-934af28ddedf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:25.649353 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c0c8d-6d88-4ff4-b5ca-934af28ddedf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:25.650090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c0c8d-6d88-4ff4-b5ca-934af28ddedf None admin] RBAC: Adding query filter params (interface=public, service_id=5f22e68cd2e44407a258f68af8533cd1, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:25.650432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c0c8d-6d88-4ff4-b5ca-934af28ddedf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:25.651879 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c0c8d-6d88-4ff4-b5ca-934af28ddedf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:25.661262 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 383/760] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 07:12:25 2022] GET /identity/v3/endpoints?service_id=5f22e68cd2e44407a258f68af8533cd1&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:25.662286 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c0c8d-6d88-4ff4-b5ca-934af28ddedf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:25.673276 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd701d68-b050-4f0a-9544-a494106af276 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:25.711277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63bc47-225c-4ecb-8d0f-05c62d2dc416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:25.712032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63bc47-225c-4ecb-8d0f-05c62d2dc416 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:25.712300 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63bc47-225c-4ecb-8d0f-05c62d2dc416 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:25.712581 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63bc47-225c-4ecb-8d0f-05c62d2dc416 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:25.721578 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63bc47-225c-4ecb-8d0f-05c62d2dc416 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:25.723229 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63bc47-225c-4ecb-8d0f-05c62d2dc416 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-3a63bc47-225c-4ecb-8d0f-05c62d2dc416 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:25.736078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:25.737036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:25.738435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:25.738435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:25.738435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:25.738435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:25.738435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:25.738435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:25.738435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:25.738435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:25.738435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:12:25.738435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:25.738435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 378/761] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 07:12:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:25.739017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63bc47-225c-4ecb-8d0f-05c62d2dc416 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:25.769660 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c0c8d-6d88-4ff4-b5ca-934af28ddedf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:25.805677 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942007b-d3f6-4018-b692-f6bc98829558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:25.806336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942007b-d3f6-4018-b692-f6bc98829558 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:25.806613 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942007b-d3f6-4018-b692-f6bc98829558 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:25.806880 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942007b-d3f6-4018-b692-f6bc98829558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:25.819526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942007b-d3f6-4018-b692-f6bc98829558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:25.821012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942007b-d3f6-4018-b692-f6bc98829558 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:25.830670 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e942007b-d3f6-4018-b692-f6bc98829558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:25.837112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:25.839434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:25.841641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:25.841641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:25.841641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:25.843197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 384/762] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:25.844443 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942007b-d3f6-4018-b692-f6bc98829558 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:25.848107 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63bc47-225c-4ecb-8d0f-05c62d2dc416 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:25.879339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:25.885200 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed1682-6a13-4dcb-b13e-9c375507ceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:25.885812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1682-6a13-4dcb-b13e-9c375507ceee None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:25.886090 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1682-6a13-4dcb-b13e-9c375507ceee None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:25.886386 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ed1682-6a13-4dcb-b13e-9c375507ceee None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:25.886996 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed1682-6a13-4dcb-b13e-9c375507ceee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:25.888437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ed1682-6a13-4dcb-b13e-9c375507ceee None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:25.894641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 379/763] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 07:12:25 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:25.895293 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed1682-6a13-4dcb-b13e-9c375507ceee None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:25.981584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942007b-d3f6-4018-b692-f6bc98829558 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:26.021913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ccecf-7f9a-453a-8945-dd4cf5434be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:26.022567 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ccecf-7f9a-453a-8945-dd4cf5434be5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.022850 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ccecf-7f9a-453a-8945-dd4cf5434be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.023124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ccecf-7f9a-453a-8945-dd4cf5434be5 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.023625 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ed1682-6a13-4dcb-b13e-9c375507ceee None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:26.023879 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ccecf-7f9a-453a-8945-dd4cf5434be5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:26.024186 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ccecf-7f9a-453a-8945-dd4cf5434be5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:26.025663 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ccecf-7f9a-453a-8945-dd4cf5434be5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:26.047516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 385/764] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 07:12:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:26.048317 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc4d4-3f88-4d8f-b530-5dd1526a4efe None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.048601 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc4d4-3f88-4d8f-b530-5dd1526a4efe None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.048874 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfc4d4-3f88-4d8f-b530-5dd1526a4efe None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.050387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 386/765] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:26.052367 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfc4d4-3f88-4d8f-b530-5dd1526a4efe None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:26.066800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b949f1-96a4-44d9-ab89-b012f87bd9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:26.067395 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b949f1-96a4-44d9-ab89-b012f87bd9cb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.067667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b949f1-96a4-44d9-ab89-b012f87bd9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.067983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b949f1-96a4-44d9-ab89-b012f87bd9cb None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.068710 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b949f1-96a4-44d9-ab89-b012f87bd9cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:26.069016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b949f1-96a4-44d9-ab89-b012f87bd9cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:26.071217 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b949f1-96a4-44d9-ab89-b012f87bd9cb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:26.084488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 380/766] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:26.085535 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef215c-4d26-4954-b768-1b9f04cfc0ec None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.085815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef215c-4d26-4954-b768-1b9f04cfc0ec None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.086328 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef215c-4d26-4954-b768-1b9f04cfc0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.106404 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-baef215c-4d26-4954-b768-1b9f04cfc0ec None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:26.107588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-baef215c-4d26-4954-b768-1b9f04cfc0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:26.128131 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:26.168274 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfc4d4-3f88-4d8f-b530-5dd1526a4efe None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:26.172989 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:26.194733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 381/767] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:26.196397 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef215c-4d26-4954-b768-1b9f04cfc0ec None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:26.227219 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed6c7-4128-41a4-91d1-1802b4929be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:26.228171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed6c7-4128-41a4-91d1-1802b4929be5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.228450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed6c7-4128-41a4-91d1-1802b4929be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.228992 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ed6c7-4128-41a4-91d1-1802b4929be5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.248066 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ed6c7-4128-41a4-91d1-1802b4929be5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:26.253162 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131ed6c7-4128-41a4-91d1-1802b4929be5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-131ed6c7-4128-41a4-91d1-1802b4929be5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:26.283743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:26.286357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:26.288514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:26.288514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:26.288514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:26.288514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 387/768] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:26.294609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed6c7-4128-41a4-91d1-1802b4929be5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:26.374268 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef215c-4d26-4954-b768-1b9f04cfc0ec None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:26.452276 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe86db7-62dc-4d54-9f7b-895371f7d148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:26.453434 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86db7-62dc-4d54-9f7b-895371f7d148 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.453830 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86db7-62dc-4d54-9f7b-895371f7d148 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.454233 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86db7-62dc-4d54-9f7b-895371f7d148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.465532 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe86db7-62dc-4d54-9f7b-895371f7d148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:26.467009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe86db7-62dc-4d54-9f7b-895371f7d148 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:26.478126 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ed6c7-4128-41a4-91d1-1802b4929be5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-bbe86db7-62dc-4d54-9f7b-895371f7d148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:26.485933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:26.486926 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:26.488420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:26.488420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:26.488420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:26.488420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:26.488420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:26.488420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:26.488420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:26.488420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:26.488420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 382/769] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:26.495236 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe86db7-62dc-4d54-9f7b-895371f7d148 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:26.496791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:26.540633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e244-0902-4ace-9749-bceb2d53450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:26.541213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e244-0902-4ace-9749-bceb2d53450d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.541499 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e244-0902-4ace-9749-bceb2d53450d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.541773 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59e244-0902-4ace-9749-bceb2d53450d None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.542459 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59e244-0902-4ace-9749-bceb2d53450d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:26.542764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59e244-0902-4ace-9749-bceb2d53450d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:26.544130 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59e244-0902-4ace-9749-bceb2d53450d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:26.556753 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 388/770] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:26.557833 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e244-0902-4ace-9749-bceb2d53450d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:26.563781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:26.638777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe86db7-62dc-4d54-9f7b-895371f7d148 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:26.675503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc09e6-cd85-4fa3-b250-ab5d8dab1d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:26.676112 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc09e6-cd85-4fa3-b250-ab5d8dab1d36 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.676391 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc09e6-cd85-4fa3-b250-ab5d8dab1d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.676687 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dc09e6-cd85-4fa3-b250-ab5d8dab1d36 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.677358 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc09e6-cd85-4fa3-b250-ab5d8dab1d36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:26.677659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc09e6-cd85-4fa3-b250-ab5d8dab1d36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:26.679140 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dc09e6-cd85-4fa3-b250-ab5d8dab1d36 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:26.692265 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 383/771] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:26.693084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc09e6-cd85-4fa3-b250-ab5d8dab1d36 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:26.699143 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59e244-0902-4ace-9749-bceb2d53450d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:26.744904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12c831-ff97-4131-934f-84b315f85299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:26.745771 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c831-ff97-4131-934f-84b315f85299 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.746082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c831-ff97-4131-934f-84b315f85299 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.746395 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c831-ff97-4131-934f-84b315f85299 None admin] PATH_INFO: `/v3/services/network` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.746975 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12c831-ff97-4131-934f-84b315f85299 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:26.748339 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12c831-ff97-4131-934f-84b315f85299 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-5f12c831-ff97-4131-934f-84b315f85299 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:26.757325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:26.758349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:12:26.759156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:26.763184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 389/772] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:26 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:26.763804 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12c831-ff97-4131-934f-84b315f85299 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:26.800252 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:26.804442 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dc09e6-cd85-4fa3-b250-ab5d8dab1d36 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:26.807138 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:26.840009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24501889-1960-4bb6-a77b-eec16483c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:26.841001 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501889-1960-4bb6-a77b-eec16483c00f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.841271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501889-1960-4bb6-a77b-eec16483c00f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.841591 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24501889-1960-4bb6-a77b-eec16483c00f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.849250 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24501889-1960-4bb6-a77b-eec16483c00f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:26.850744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24501889-1960-4bb6-a77b-eec16483c00f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-24501889-1960-4bb6-a77b-eec16483c00f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:26.862549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:26.863415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:26.864322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:26.864322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:26.864322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:26.864322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:26.864322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:26.864322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:26.864322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:26.864322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:26.868205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 384/773] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:26.869379 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5a426-e91b-4ae5-a6d0-bdd7df475f0c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.869663 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5a426-e91b-4ae5-a6d0-bdd7df475f0c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.869935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5a426-e91b-4ae5-a6d0-bdd7df475f0c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.871229 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 385/774] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:26.871911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5a426-e91b-4ae5-a6d0-bdd7df475f0c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:26.879942 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12c831-ff97-4131-934f-84b315f85299 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:26.922567 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911a2a4-adc1-4b9a-9863-3807bd16896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:26.923496 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911a2a4-adc1-4b9a-9863-3807bd16896c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:26.923780 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911a2a4-adc1-4b9a-9863-3807bd16896c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:26.924053 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911a2a4-adc1-4b9a-9863-3807bd16896c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:26.924775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911a2a4-adc1-4b9a-9863-3807bd16896c None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=29d8f357765e4b46887c9cf7242de24f) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:26.925085 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911a2a4-adc1-4b9a-9863-3807bd16896c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:26.926539 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911a2a4-adc1-4b9a-9863-3807bd16896c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:26.942143 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 390/775] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:26 2022] GET /identity/v3/role_assignments?user.id=29d8f357765e4b46887c9cf7242de24f&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:26.942143 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911a2a4-adc1-4b9a-9863-3807bd16896c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:26.997695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5a426-e91b-4ae5-a6d0-bdd7df475f0c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:27.038575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b6076-35c1-4ba1-8279-e9764db43a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:27.039287 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b6076-35c1-4ba1-8279-e9764db43a82 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:27.039631 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b6076-35c1-4ba1-8279-e9764db43a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:27.040074 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b6076-35c1-4ba1-8279-e9764db43a82 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:27.040883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b6076-35c1-4ba1-8279-e9764db43a82 None admin] RBAC: Adding query filter params (name=network) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:27.041186 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b6076-35c1-4ba1-8279-e9764db43a82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:27.043189 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3b6076-35c1-4ba1-8279-e9764db43a82 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:27.048626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 386/776] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:27.050029 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a647-3e6e-4a59-aaf6-100dbdeac7a1 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:27.050390 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a647-3e6e-4a59-aaf6-100dbdeac7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:27.050604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9a647-3e6e-4a59-aaf6-100dbdeac7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:27.082773 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:27.088281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-acb9a647-3e6e-4a59-aaf6-100dbdeac7a1 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:27.088948 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911a2a4-adc1-4b9a-9863-3807bd16896c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:27.091734 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-acb9a647-3e6e-4a59-aaf6-100dbdeac7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:27.121278 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:27.137951 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307be311-2dd2-4d47-9fc9-37ac90933961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:27.138589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307be311-2dd2-4d47-9fc9-37ac90933961 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:27.138871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307be311-2dd2-4d47-9fc9-37ac90933961 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:27.139145 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307be311-2dd2-4d47-9fc9-37ac90933961 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:27.139849 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307be311-2dd2-4d47-9fc9-37ac90933961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:27.140155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307be311-2dd2-4d47-9fc9-37ac90933961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:27.142401 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307be311-2dd2-4d47-9fc9-37ac90933961 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:27.155078 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 391/777] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:27.155972 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307be311-2dd2-4d47-9fc9-37ac90933961 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:27.186281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 387/778] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:27.187452 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9a647-3e6e-4a59-aaf6-100dbdeac7a1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:27.282400 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307be311-2dd2-4d47-9fc9-37ac90933961 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:27.325353 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b734a-9854-4710-8e2e-f2f0f90bb29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:27.325878 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b734a-9854-4710-8e2e-f2f0f90bb29b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:27.326175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b734a-9854-4710-8e2e-f2f0f90bb29b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:27.326447 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b734a-9854-4710-8e2e-f2f0f90bb29b None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:27.327070 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b734a-9854-4710-8e2e-f2f0f90bb29b None admin] RBAC: Adding query filter params (type=network) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:27.327631 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b734a-9854-4710-8e2e-f2f0f90bb29b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:27.329586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b734a-9854-4710-8e2e-f2f0f90bb29b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:27.335743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 392/779] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:27.343739 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b734a-9854-4710-8e2e-f2f0f90bb29b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:27.377552 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:27.397645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9a647-3e6e-4a59-aaf6-100dbdeac7a1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:27.446453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b1347-6622-4587-a74b-46fea04cd0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:27.447110 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b1347-6622-4587-a74b-46fea04cd0b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:27.447392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b1347-6622-4587-a74b-46fea04cd0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:27.447670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b1347-6622-4587-a74b-46fea04cd0b8 None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/bb99f54d9320496cbcc52d535fa64789/roles/afe88bc03d30494b89892587177c79de` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:27.449639 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b1347-6622-4587-a74b-46fea04cd0b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=bb99f54d9320496cbcc52d535fa64789, role_id=afe88bc03d30494b89892587177c79de)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:27.451145 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0b1347-6622-4587-a74b-46fea04cd0b8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:27.493850 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b734a-9854-4710-8e2e-f2f0f90bb29b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:27.523398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 388/780] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:12:27 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/bb99f54d9320496cbcc52d535fa64789/roles/afe88bc03d30494b89892587177c79de => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:12:27.540091 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d223e0e-7d94-4ee2-98a9-347dd6c30919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:27.540745 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d223e0e-7d94-4ee2-98a9-347dd6c30919 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:27.541134 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d223e0e-7d94-4ee2-98a9-347dd6c30919 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:27.541411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d223e0e-7d94-4ee2-98a9-347dd6c30919 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:27.542216 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d223e0e-7d94-4ee2-98a9-347dd6c30919 None admin] RBAC: Adding query filter params (interface=public, service_id=09b6aaa3782f41bdbfbbc0ca555bf6d1, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:27.542575 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d223e0e-7d94-4ee2-98a9-347dd6c30919 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:27.545121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d223e0e-7d94-4ee2-98a9-347dd6c30919 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:27.551614 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 393/781] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 07:12:27 2022] GET /identity/v3/endpoints?service_id=09b6aaa3782f41bdbfbbc0ca555bf6d1&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:27.557409 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b1347-6622-4587-a74b-46fea04cd0b8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:27.576570 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d223e0e-7d94-4ee2-98a9-347dd6c30919 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:27.601405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:27.750686 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:27.754797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b1347-6622-4587-a74b-46fea04cd0b8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:27.760061 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d223e0e-7d94-4ee2-98a9-347dd6c30919 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:27.792057 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b85f3-9a0f-4e6c-85dd-22e61d3f55e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:27.792673 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b85f3-9a0f-4e6c-85dd-22e61d3f55e4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:27.792952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b85f3-9a0f-4e6c-85dd-22e61d3f55e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:27.793282 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b85f3-9a0f-4e6c-85dd-22e61d3f55e4 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:27.793891 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b85f3-9a0f-4e6c-85dd-22e61d3f55e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:27.795499 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b85f3-9a0f-4e6c-85dd-22e61d3f55e4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:27.799512 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf94e32-c16a-41b8-b55f-02e0180f5007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:27.800353 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf94e32-c16a-41b8-b55f-02e0180f5007 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:27.800926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf94e32-c16a-41b8-b55f-02e0180f5007 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:27.801722 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf94e32-c16a-41b8-b55f-02e0180f5007 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:27.802160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 389/782] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 07:12:27 2022] GET /identity/v3/services => generated 772 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:27.822069 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf94e32-c16a-41b8-b55f-02e0180f5007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-9cf94e32-c16a-41b8-b55f-02e0180f5007 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:27.827540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:27.829388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:27.830516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:27.833150 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 394/783] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:27.838867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b85f3-9a0f-4e6c-85dd-22e61d3f55e4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:27.930575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:27.949591 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b85f3-9a0f-4e6c-85dd-22e61d3f55e4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:27.977633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa72b9-db18-426b-a18d-df3ae5b153a8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:27.978331 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa72b9-db18-426b-a18d-df3ae5b153a8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:27.978907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa72b9-db18-426b-a18d-df3ae5b153a8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:27.980978 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 395/784] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:27.988000 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c7b8b-8bf4-4f8e-ba75-39fe428f9656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:27.988628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7b8b-8bf4-4f8e-ba75-39fe428f9656 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:27.988909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7b8b-8bf4-4f8e-ba75-39fe428f9656 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:27.989179 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7b8b-8bf4-4f8e-ba75-39fe428f9656 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:27.989852 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c7b8b-8bf4-4f8e-ba75-39fe428f9656 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:27.990186 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c7b8b-8bf4-4f8e-ba75-39fe428f9656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:27.991572 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c7b8b-8bf4-4f8e-ba75-39fe428f9656 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:27.997406 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83c77f-1ec9-4271-9079-4ff3b34b0b40 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:27.997695 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83c77f-1ec9-4271-9079-4ff3b34b0b40 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:27.997968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c83c77f-1ec9-4271-9079-4ff3b34b0b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:28.006645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 390/785] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:12:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:28.012222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c7b8b-8bf4-4f8e-ba75-39fe428f9656 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:28.026367 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2c83c77f-1ec9-4271-9079-4ff3b34b0b40 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:28.027575 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2c83c77f-1ec9-4271-9079-4ff3b34b0b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:28.123230 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 396/786] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:12:28.137088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c7b8b-8bf4-4f8e-ba75-39fe428f9656 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:28.190353 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d240b1-ed89-4f9c-b0da-08e33bbdc14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:28.190968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d240b1-ed89-4f9c-b0da-08e33bbdc14b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:28.191250 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d240b1-ed89-4f9c-b0da-08e33bbdc14b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:28.191526 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d240b1-ed89-4f9c-b0da-08e33bbdc14b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:28.209086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d240b1-ed89-4f9c-b0da-08e33bbdc14b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:28.210567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d240b1-ed89-4f9c-b0da-08e33bbdc14b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:28.216818 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c6d240b1-ed89-4f9c-b0da-08e33bbdc14b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:28.229471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:28.230755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:28.231651 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:28.231651 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:28.231651 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:28.231651 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 391/787] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:28.236873 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83c77f-1ec9-4271-9079-4ff3b34b0b40 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:28.346451 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:28.375912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c83c77f-1ec9-4271-9079-4ff3b34b0b40 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:28.420089 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791fc9c-e474-4620-a260-281af4f34891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:28.420696 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791fc9c-e474-4620-a260-281af4f34891 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:28.420976 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791fc9c-e474-4620-a260-281af4f34891 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:28.421256 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791fc9c-e474-4620-a260-281af4f34891 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:28.421949 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791fc9c-e474-4620-a260-281af4f34891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:28.422363 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791fc9c-e474-4620-a260-281af4f34891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:28.423740 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791fc9c-e474-4620-a260-281af4f34891 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:28.430086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d240b1-ed89-4f9c-b0da-08e33bbdc14b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:28.439190 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 397/788] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:28.447580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791fc9c-e474-4620-a260-281af4f34891 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:28.557513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791fc9c-e474-4620-a260-281af4f34891 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:28.604011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76cb98-4ac9-4c31-aedc-8c6c2bbe51eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:28.604649 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76cb98-4ac9-4c31-aedc-8c6c2bbe51eb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:28.604932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76cb98-4ac9-4c31-aedc-8c6c2bbe51eb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:28.605208 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76cb98-4ac9-4c31-aedc-8c6c2bbe51eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:28.611203 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:28.617137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76cb98-4ac9-4c31-aedc-8c6c2bbe51eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:28.635963 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76cb98-4ac9-4c31-aedc-8c6c2bbe51eb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:28.636120 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d240b1-ed89-4f9c-b0da-08e33bbdc14b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7d76cb98-4ac9-4c31-aedc-8c6c2bbe51eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:28.639591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:28.641057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:28.641980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:28.641980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:28.641980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:28.641980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:28.641980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:28.641980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:28.641980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:28.641980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:28.641980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:28.641980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:28.641980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 398/789] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:28.647477 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76cb98-4ac9-4c31-aedc-8c6c2bbe51eb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:28.673184 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef046e86-aa47-4b01-a0ad-8d1cd058e0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:28.674309 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef046e86-aa47-4b01-a0ad-8d1cd058e0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:28.675373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef046e86-aa47-4b01-a0ad-8d1cd058e0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:28.675671 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef046e86-aa47-4b01-a0ad-8d1cd058e0b8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:28.676472 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef046e86-aa47-4b01-a0ad-8d1cd058e0b8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:28.679883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef046e86-aa47-4b01-a0ad-8d1cd058e0b8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ef046e86-aa47-4b01-a0ad-8d1cd058e0b8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:28.695337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:28.697746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:28.699781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 392/790] 10.222.0.16 () {56 vars in 1129 bytes} [Tue Aug 23 07:12:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:28.706137 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef046e86-aa47-4b01-a0ad-8d1cd058e0b8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:28.773638 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:28.808128 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef046e86-aa47-4b01-a0ad-8d1cd058e0b8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:28.845342 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a66d57-5e65-4b51-907e-29e64bf42976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:28.845945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66d57-5e65-4b51-907e-29e64bf42976 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:28.846247 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66d57-5e65-4b51-907e-29e64bf42976 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:28.846516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a66d57-5e65-4b51-907e-29e64bf42976 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:28.847140 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a66d57-5e65-4b51-907e-29e64bf42976 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:28.847435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a66d57-5e65-4b51-907e-29e64bf42976 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:28.848962 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a66d57-5e65-4b51-907e-29e64bf42976 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:28.854019 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 393/791] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 07:12:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:28.859761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a66d57-5e65-4b51-907e-29e64bf42976 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:28.960486 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76cb98-4ac9-4c31-aedc-8c6c2bbe51eb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:28.966743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a66d57-5e65-4b51-907e-29e64bf42976 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:28.998503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:29.004668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10296fbd-3115-4181-9214-cf12a3d021be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:29.005357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10296fbd-3115-4181-9214-cf12a3d021be None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:29.005631 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10296fbd-3115-4181-9214-cf12a3d021be None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:29.005902 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10296fbd-3115-4181-9214-cf12a3d021be None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:29.006559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10296fbd-3115-4181-9214-cf12a3d021be None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:29.006853 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10296fbd-3115-4181-9214-cf12a3d021be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:29.008211 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10296fbd-3115-4181-9214-cf12a3d021be None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:29.013740 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 394/792] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 23 07:12:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:29.020445 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10296fbd-3115-4181-9214-cf12a3d021be None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:29.086818 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8ced4-7338-4400-8816-d85230453414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:29.087438 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8ced4-7338-4400-8816-d85230453414 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:29.087721 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8ced4-7338-4400-8816-d85230453414 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:29.087996 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8ced4-7338-4400-8816-d85230453414 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:29.088742 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8ced4-7338-4400-8816-d85230453414 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:29.089046 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8ced4-7338-4400-8816-d85230453414 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:29.090767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8ced4-7338-4400-8816-d85230453414 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:29.127700 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10296fbd-3115-4181-9214-cf12a3d021be None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:29.136418 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 399/793] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 07:12:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:29.147106 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8ced4-7338-4400-8816-d85230453414 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:29.162805 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0f031-2e97-4e51-9d89-0bdb308f289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:29.163410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f031-2e97-4e51-9d89-0bdb308f289b None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:29.163687 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f031-2e97-4e51-9d89-0bdb308f289b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:29.163953 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0f031-2e97-4e51-9d89-0bdb308f289b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:29.164614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0f031-2e97-4e51-9d89-0bdb308f289b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:29.166028 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0f031-2e97-4e51-9d89-0bdb308f289b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:29.241763 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:29.263600 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 395/794] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 07:12:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:12:29.291349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8ced4-7338-4400-8816-d85230453414 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:29.307242 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a3458-648a-4a9c-bfd2-8f6b08d966bc None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:29.307567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a3458-648a-4a9c-bfd2-8f6b08d966bc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:29.307929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a3458-648a-4a9c-bfd2-8f6b08d966bc None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:29.309460 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 396/795] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:29.321042 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b55d-fb4f-4802-b2bf-4eeabcfb89ec None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:29.321263 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b55d-fb4f-4802-b2bf-4eeabcfb89ec None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:29.321473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256b55d-fb4f-4802-b2bf-4eeabcfb89ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:29.355011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb5675-c079-4da0-bd0b-9b2579ffb587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:29.356026 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb5675-c079-4da0-bd0b-9b2579ffb587 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:29.356510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb5675-c079-4da0-bd0b-9b2579ffb587 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:29.357014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb5675-c079-4da0-bd0b-9b2579ffb587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:29.361815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1256b55d-fb4f-4802-b2bf-4eeabcfb89ec None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:29.363542 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1256b55d-fb4f-4802-b2bf-4eeabcfb89ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:29.378995 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb5675-c079-4da0-bd0b-9b2579ffb587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:29.380816 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb5675-c079-4da0-bd0b-9b2579ffb587 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a1cb5675-c079-4da0-bd0b-9b2579ffb587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:29.411056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:29.412054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:29.412967 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:29.412967 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:29.412967 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:29.422518 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:29.422970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 400/796] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:29.428761 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb5675-c079-4da0-bd0b-9b2579ffb587 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:29.462130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 397/797] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:29.578341 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb5675-c079-4da0-bd0b-9b2579ffb587 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:29.589929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:29.638814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6265fa-a9a3-4133-bdeb-9cd74600d25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:29.639417 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6265fa-a9a3-4133-bdeb-9cd74600d25a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:29.639694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6265fa-a9a3-4133-bdeb-9cd74600d25a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:29.639965 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6265fa-a9a3-4133-bdeb-9cd74600d25a None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:29.641344 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6265fa-a9a3-4133-bdeb-9cd74600d25a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:29.641649 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6265fa-a9a3-4133-bdeb-9cd74600d25a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:29.646390 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6265fa-a9a3-4133-bdeb-9cd74600d25a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:29.670450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 401/798] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:29.676866 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b55d-fb4f-4802-b2bf-4eeabcfb89ec None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:29.830632 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6265fa-a9a3-4133-bdeb-9cd74600d25a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:29.853292 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256b55d-fb4f-4802-b2bf-4eeabcfb89ec None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:29.918542 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8934a-18d5-46b0-8e17-9587d6f8a924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:29.919187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8934a-18d5-46b0-8e17-9587d6f8a924 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:29.919466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8934a-18d5-46b0-8e17-9587d6f8a924 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:29.919738 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8934a-18d5-46b0-8e17-9587d6f8a924 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:29.933371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8934a-18d5-46b0-8e17-9587d6f8a924 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:29.934813 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8934a-18d5-46b0-8e17-9587d6f8a924 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f5d8934a-18d5-46b0-8e17-9587d6f8a924 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:29.954392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:29.955360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:29.956246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:29.956246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:29.956246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:29.956246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:29.956246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:29.956246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:29.956246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:29.956246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:29.956681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 398/799] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:29.972470 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8934a-18d5-46b0-8e17-9587d6f8a924 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:30.024037 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6265fa-a9a3-4133-bdeb-9cd74600d25a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:30.042471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:30.087304 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96681c96-83ad-45ec-bddc-d515423857a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:30.088292 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96681c96-83ad-45ec-bddc-d515423857a7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.088780 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96681c96-83ad-45ec-bddc-d515423857a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.089252 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96681c96-83ad-45ec-bddc-d515423857a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.101729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96681c96-83ad-45ec-bddc-d515423857a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-96681c96-83ad-45ec-bddc-d515423857a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:30.107312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:30.108240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:30.109381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:30.112300 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 402/800] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:30.113825 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933fce-47e5-4210-873e-9b53cb9b16d3 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.114338 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933fce-47e5-4210-873e-9b53cb9b16d3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.114817 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c933fce-47e5-4210-873e-9b53cb9b16d3 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.120671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 403/801] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:30.121718 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c933fce-47e5-4210-873e-9b53cb9b16d3 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:30.141002 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8934a-18d5-46b0-8e17-9587d6f8a924 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:30.148192 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:30.185542 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e297d6b3-3573-4441-b773-b1eb5cfa65c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:30.186182 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297d6b3-3573-4441-b773-b1eb5cfa65c7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.186505 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297d6b3-3573-4441-b773-b1eb5cfa65c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.187661 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e297d6b3-3573-4441-b773-b1eb5cfa65c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.188642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297d6b3-3573-4441-b773-b1eb5cfa65c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:30.188968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297d6b3-3573-4441-b773-b1eb5cfa65c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:30.190580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e297d6b3-3573-4441-b773-b1eb5cfa65c7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:30.210201 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 399/802] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:30.210201 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc79ed-f2ce-47ab-8791-42f34244a990 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.210201 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc79ed-f2ce-47ab-8791-42f34244a990 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.210201 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc79ed-f2ce-47ab-8791-42f34244a990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.229443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-dbcc79ed-f2ce-47ab-8791-42f34244a990 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:30.229443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-dbcc79ed-f2ce-47ab-8791-42f34244a990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:30.242954 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c933fce-47e5-4210-873e-9b53cb9b16d3 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:30.281474 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94050f7d-fe77-407c-b919-99c23cc4314f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:30.282072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94050f7d-fe77-407c-b919-99c23cc4314f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.282377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94050f7d-fe77-407c-b919-99c23cc4314f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.282640 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94050f7d-fe77-407c-b919-99c23cc4314f None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.283307 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94050f7d-fe77-407c-b919-99c23cc4314f None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:30.283602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94050f7d-fe77-407c-b919-99c23cc4314f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:30.285063 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94050f7d-fe77-407c-b919-99c23cc4314f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:30.298258 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 404/803] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:30.299588 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94050f7d-fe77-407c-b919-99c23cc4314f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:30.299806 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 400/804] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:30.300955 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69bade-3024-4c17-82f2-8a3d84e90554 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.301242 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69bade-3024-4c17-82f2-8a3d84e90554 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.301513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69bade-3024-4c17-82f2-8a3d84e90554 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.306802 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 401/805] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:30.306802 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69bade-3024-4c17-82f2-8a3d84e90554 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:30.346610 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:30.397775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:30.417607 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94050f7d-fe77-407c-b919-99c23cc4314f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:30.450846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69bade-3024-4c17-82f2-8a3d84e90554 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:30.455460 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52f3e5-398d-4afa-8c2f-6719883af767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:30.456229 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52f3e5-398d-4afa-8c2f-6719883af767 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.456611 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52f3e5-398d-4afa-8c2f-6719883af767 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.456985 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52f3e5-398d-4afa-8c2f-6719883af767 None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/b115a3ce93804ddbaf542934addb506b/roles/afe88bc03d30494b89892587177c79de` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.459071 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52f3e5-398d-4afa-8c2f-6719883af767 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=b115a3ce93804ddbaf542934addb506b, role_id=afe88bc03d30494b89892587177c79de)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:30.460757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b52f3e5-398d-4afa-8c2f-6719883af767 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:30.489873 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae7201f-9614-4ce8-9535-c428d4a229de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:30.490760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7201f-9614-4ce8-9535-c428d4a229de None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.491184 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7201f-9614-4ce8-9535-c428d4a229de None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.491616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae7201f-9614-4ce8-9535-c428d4a229de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.502067 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7201f-9614-4ce8-9535-c428d4a229de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:30.503668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae7201f-9614-4ce8-9535-c428d4a229de None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-aae7201f-9614-4ce8-9535-c428d4a229de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:30.518152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:30.519285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:30.520379 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:30.520379 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:30.520379 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:30.522028 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 402/806] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:30.523447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a611e-63ee-4b13-90d6-f7964c8cccc7 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.523857 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a611e-63ee-4b13-90d6-f7964c8cccc7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.524255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a611e-63ee-4b13-90d6-f7964c8cccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.536089 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 405/807] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:12:30 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/b115a3ce93804ddbaf542934addb506b/roles/afe88bc03d30494b89892587177c79de => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:12:30.537248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52f3e5-398d-4afa-8c2f-6719883af767 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:30.544375 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c35a611e-63ee-4b13-90d6-f7964c8cccc7 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:30.545903 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c35a611e-63ee-4b13-90d6-f7964c8cccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:30.650476 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 403/808] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:30.652560 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a611e-63ee-4b13-90d6-f7964c8cccc7 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:30.670886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:30.720911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52f3e5-398d-4afa-8c2f-6719883af767 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:30.763491 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78302045-71ad-4c96-8b34-ff723da78da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:30.764260 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78302045-71ad-4c96-8b34-ff723da78da7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.764646 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78302045-71ad-4c96-8b34-ff723da78da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.764915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78302045-71ad-4c96-8b34-ff723da78da7 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.765740 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78302045-71ad-4c96-8b34-ff723da78da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:30.766041 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78302045-71ad-4c96-8b34-ff723da78da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:30.767545 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78302045-71ad-4c96-8b34-ff723da78da7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:30.782744 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 406/809] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:30.788370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78302045-71ad-4c96-8b34-ff723da78da7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:30.793129 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:30.811593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a611e-63ee-4b13-90d6-f7964c8cccc7 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:30.854247 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad393a-775f-46ee-90ab-16732415cc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:30.855319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad393a-775f-46ee-90ab-16732415cc78 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.856056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad393a-775f-46ee-90ab-16732415cc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.856738 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad393a-775f-46ee-90ab-16732415cc78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.870774 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad393a-775f-46ee-90ab-16732415cc78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-c0ad393a-775f-46ee-90ab-16732415cc78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:30.876498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:30.877475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:30.878349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:30.881020 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 404/810] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:30.886261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad393a-775f-46ee-90ab-16732415cc78 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:30.935152 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78302045-71ad-4c96-8b34-ff723da78da7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:30.995378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0087f-f988-47e6-95cc-2cbe55732aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:30.996008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0087f-f988-47e6-95cc-2cbe55732aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:30.996286 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0087f-f988-47e6-95cc-2cbe55732aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:30.996556 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0087f-f988-47e6-95cc-2cbe55732aa4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:30.998129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:31.006768 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0087f-f988-47e6-95cc-2cbe55732aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.008245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0087f-f988-47e6-95cc-2cbe55732aa4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-dfe0087f-f988-47e6-95cc-2cbe55732aa4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:31.024007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:31.025171 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 407/811] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 07:12:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:31.026584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0087f-f988-47e6-95cc-2cbe55732aa4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:31.043480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad393a-775f-46ee-90ab-16732415cc78 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:31.088780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99c80e-774e-4a62-b3a3-c87fb3225823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:31.089880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99c80e-774e-4a62-b3a3-c87fb3225823 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.090335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99c80e-774e-4a62-b3a3-c87fb3225823 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.090747 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee99c80e-774e-4a62-b3a3-c87fb3225823 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.091996 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99c80e-774e-4a62-b3a3-c87fb3225823 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:31.092450 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99c80e-774e-4a62-b3a3-c87fb3225823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.095220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee99c80e-774e-4a62-b3a3-c87fb3225823 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:31.102299 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:31.106903 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 405/812] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:12:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:31.108541 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99c80e-774e-4a62-b3a3-c87fb3225823 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:31.151241 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0087f-f988-47e6-95cc-2cbe55732aa4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:31.199518 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65edc5-38bc-4e99-b33a-941f899b8eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:31.200070 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65edc5-38bc-4e99-b33a-941f899b8eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.200419 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65edc5-38bc-4e99-b33a-941f899b8eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.200698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65edc5-38bc-4e99-b33a-941f899b8eb5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.201291 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65edc5-38bc-4e99-b33a-941f899b8eb5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.202801 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce65edc5-38bc-4e99-b33a-941f899b8eb5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ce65edc5-38bc-4e99-b33a-941f899b8eb5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:31.215775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:31.217003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 07:12:31.218767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:31.222199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 408/813] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:31 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:31.223031 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65edc5-38bc-4e99-b33a-941f899b8eb5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:31.236547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee99c80e-774e-4a62-b3a3-c87fb3225823 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:31.263640 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:31.272098 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9dda0-1864-497e-b70b-87047a1c15cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:31.272828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9dda0-1864-497e-b70b-87047a1c15cd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.273105 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9dda0-1864-497e-b70b-87047a1c15cd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.273377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af9dda0-1864-497e-b70b-87047a1c15cd None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.274113 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9dda0-1864-497e-b70b-87047a1c15cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:31.276772 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9dda0-1864-497e-b70b-87047a1c15cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.276772 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af9dda0-1864-497e-b70b-87047a1c15cd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:31.298036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 406/814] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 07:12:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:31.298714 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9dda0-1864-497e-b70b-87047a1c15cd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:31.350187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65edc5-38bc-4e99-b33a-941f899b8eb5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:31.392188 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cbac2-090a-4bc1-9528-599607132d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:31.393054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cbac2-090a-4bc1-9528-599607132d7c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.393425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cbac2-090a-4bc1-9528-599607132d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.393767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cbac2-090a-4bc1-9528-599607132d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.404977 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:31.407035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cbac2-090a-4bc1-9528-599607132d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.407560 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af9dda0-1864-497e-b70b-87047a1c15cd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:31.408725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cbac2-090a-4bc1-9528-599607132d7c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-4e4cbac2-090a-4bc1-9528-599607132d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:31.428117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:31.429087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:31.429949 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:31.429949 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:31.429949 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:31.434512 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 409/815] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:31.435589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cbac2-090a-4bc1-9528-599607132d7c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:31.444253 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d698b-31ae-4a71-b73d-ff2ef66d89f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:31.444874 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d698b-31ae-4a71-b73d-ff2ef66d89f7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.445252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d698b-31ae-4a71-b73d-ff2ef66d89f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.445532 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d698b-31ae-4a71-b73d-ff2ef66d89f7 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.446203 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d698b-31ae-4a71-b73d-ff2ef66d89f7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:31.446536 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d698b-31ae-4a71-b73d-ff2ef66d89f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.448009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d698b-31ae-4a71-b73d-ff2ef66d89f7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:31.453607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 407/816] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:31.458527 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d698b-31ae-4a71-b73d-ff2ef66d89f7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:31.510783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:31.547536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cbac2-090a-4bc1-9528-599607132d7c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:31.563711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d698b-31ae-4a71-b73d-ff2ef66d89f7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:31.590539 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb444967-cc46-43f7-8995-eed053388925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:31.597600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb444967-cc46-43f7-8995-eed053388925 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.598196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb444967-cc46-43f7-8995-eed053388925 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.598709 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb444967-cc46-43f7-8995-eed053388925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.600536 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683e91d-f4c2-44dc-85b4-821c5c11e8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:31.601223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683e91d-f4c2-44dc-85b4-821c5c11e8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.601574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683e91d-f4c2-44dc-85b4-821c5c11e8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.601920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683e91d-f4c2-44dc-85b4-821c5c11e8b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.602677 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683e91d-f4c2-44dc-85b4-821c5c11e8b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:31.603101 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683e91d-f4c2-44dc-85b4-821c5c11e8b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.604568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683e91d-f4c2-44dc-85b4-821c5c11e8b9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:31.612137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb444967-cc46-43f7-8995-eed053388925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.613742 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb444967-cc46-43f7-8995-eed053388925 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:31.621994 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 408/817] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:31.621994 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683e91d-f4c2-44dc-85b4-821c5c11e8b9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-eb444967-cc46-43f7-8995-eed053388925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:31.634086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:31.635295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:31.636386 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:31.636386 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:31.636386 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:31.638122 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 410/818] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:31.639140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb444967-cc46-43f7-8995-eed053388925 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:31.673844 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:31.731377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683e91d-f4c2-44dc-85b4-821c5c11e8b9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:31.748911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:31.752768 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb444967-cc46-43f7-8995-eed053388925 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:31.778443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93945b09-2917-4fe3-af87-31905a6812b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:31.779179 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93945b09-2917-4fe3-af87-31905a6812b7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.779917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93945b09-2917-4fe3-af87-31905a6812b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.780270 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93945b09-2917-4fe3-af87-31905a6812b7 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.781888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93945b09-2917-4fe3-af87-31905a6812b7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:31.782349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93945b09-2917-4fe3-af87-31905a6812b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.784281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93945b09-2917-4fe3-af87-31905a6812b7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:31.791161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 409/819] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:31.792082 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93945b09-2917-4fe3-af87-31905a6812b7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:31.796215 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc81ea9-b847-4430-b59b-4a90dc7e4053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:31.797632 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81ea9-b847-4430-b59b-4a90dc7e4053 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.797913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81ea9-b847-4430-b59b-4a90dc7e4053 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.798206 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc81ea9-b847-4430-b59b-4a90dc7e4053 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.805884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc81ea9-b847-4430-b59b-4a90dc7e4053 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.807356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc81ea9-b847-4430-b59b-4a90dc7e4053 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8dc81ea9-b847-4430-b59b-4a90dc7e4053 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:31.819358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:31.820351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 411/820] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 07:12:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3de5e-f0e4-40e7-9945-47fef9b4fea6 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.822232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3de5e-f0e4-40e7-9945-47fef9b4fea6 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.822967 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3de5e-f0e4-40e7-9945-47fef9b4fea6 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.826335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 412/821] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:31.826335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3de5e-f0e4-40e7-9945-47fef9b4fea6 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:31.911182 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93945b09-2917-4fe3-af87-31905a6812b7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:31.925015 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:31.935083 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3de5e-f0e4-40e7-9945-47fef9b4fea6 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:31.947220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb17d0-e57a-4b1a-bed8-3b16318a06bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:31.947838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb17d0-e57a-4b1a-bed8-3b16318a06bd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.948163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb17d0-e57a-4b1a-bed8-3b16318a06bd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.948438 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb17d0-e57a-4b1a-bed8-3b16318a06bd None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.949077 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb17d0-e57a-4b1a-bed8-3b16318a06bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:31.949377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb17d0-e57a-4b1a-bed8-3b16318a06bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.950821 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb17d0-e57a-4b1a-bed8-3b16318a06bd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:31.962240 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 410/822] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:31.963037 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb17d0-e57a-4b1a-bed8-3b16318a06bd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:31.976822 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942eb08-def8-4bc9-9e48-71183b0c9a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:31.977425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942eb08-def8-4bc9-9e48-71183b0c9a15 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:31.977701 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942eb08-def8-4bc9-9e48-71183b0c9a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:31.977972 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942eb08-def8-4bc9-9e48-71183b0c9a15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:31.978667 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942eb08-def8-4bc9-9e48-71183b0c9a15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:31.980015 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942eb08-def8-4bc9-9e48-71183b0c9a15 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:32.003012 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:32.042534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 413/823] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 07:12:31 2022] POST /identity/v3/endpoints => generated 337 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:32.044202 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07a022-7a04-4ccf-a443-fe124a579b15 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:32.044540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07a022-7a04-4ccf-a443-fe124a579b15 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:32.044815 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07a022-7a04-4ccf-a443-fe124a579b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:32.066539 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-5f07a022-7a04-4ccf-a443-fe124a579b15 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:32.067857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-5f07a022-7a04-4ccf-a443-fe124a579b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:32.087035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb17d0-e57a-4b1a-bed8-3b16318a06bd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:32.148284 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed81a90-ee4a-4fc7-b59b-917d6e2015da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:32.148888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81a90-ee4a-4fc7-b59b-917d6e2015da None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:32.149175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81a90-ee4a-4fc7-b59b-917d6e2015da None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:32.149480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81a90-ee4a-4fc7-b59b-917d6e2015da None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:32.150251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed81a90-ee4a-4fc7-b59b-917d6e2015da None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:32.150596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed81a90-ee4a-4fc7-b59b-917d6e2015da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:32.152184 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed81a90-ee4a-4fc7-b59b-917d6e2015da None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:32.164229 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 414/824] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:32.165903 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07a022-7a04-4ccf-a443-fe124a579b15 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:32.188703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 411/825] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 07:12:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:32.194809 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed81a90-ee4a-4fc7-b59b-917d6e2015da None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:32.273431 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:32.302434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07a022-7a04-4ccf-a443-fe124a579b15 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:32.312968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:32.327767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed81a90-ee4a-4fc7-b59b-917d6e2015da None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:32.350314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97087e26-227c-45cf-8cde-734e38ba4f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:32.351247 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97087e26-227c-45cf-8cde-734e38ba4f10 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:32.351738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97087e26-227c-45cf-8cde-734e38ba4f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:32.352184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97087e26-227c-45cf-8cde-734e38ba4f10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:32.363092 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97087e26-227c-45cf-8cde-734e38ba4f10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:32.365451 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97087e26-227c-45cf-8cde-734e38ba4f10 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:32.372217 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528beec4-b736-49d4-9cdf-0ef0a7548e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:32.373147 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528beec4-b736-49d4-9cdf-0ef0a7548e2f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:32.373629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528beec4-b736-49d4-9cdf-0ef0a7548e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:32.374138 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528beec4-b736-49d4-9cdf-0ef0a7548e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-97087e26-227c-45cf-8cde-734e38ba4f10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:32.382064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:32.383023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:32.383929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:32.383929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:32.383929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:32.383929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:32.383929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:32.383929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:32.383929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:32.383929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:32.383929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 415/826] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:32.393271 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97087e26-227c-45cf-8cde-734e38ba4f10 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:32.470414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528beec4-b736-49d4-9cdf-0ef0a7548e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:32.472553 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528beec4-b736-49d4-9cdf-0ef0a7548e2f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:32.516146 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97087e26-227c-45cf-8cde-734e38ba4f10 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:32.552232 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f246a-57f7-463a-bc44-dac6bcd8bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:32.552755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f246a-57f7-463a-bc44-dac6bcd8bb1f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:32.553369 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f246a-57f7-463a-bc44-dac6bcd8bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:32.553477 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f246a-57f7-463a-bc44-dac6bcd8bb1f None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:32.554086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f246a-57f7-463a-bc44-dac6bcd8bb1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:32.554535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f246a-57f7-463a-bc44-dac6bcd8bb1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:32.555956 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f246a-57f7-463a-bc44-dac6bcd8bb1f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:32.563692 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:32.564307 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:32.574267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 416/827] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:32.575187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f246a-57f7-463a-bc44-dac6bcd8bb1f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:32.578804 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 412/828] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 07:12:32.579616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528beec4-b736-49d4-9cdf-0ef0a7548e2f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:32.688196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f246a-57f7-463a-bc44-dac6bcd8bb1f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:32.688713 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528beec4-b736-49d4-9cdf-0ef0a7548e2f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:32.724788 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d5cca-90a2-4a90-9c71-17f328c1a612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:32.725442 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d5cca-90a2-4a90-9c71-17f328c1a612 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:32.725720 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d5cca-90a2-4a90-9c71-17f328c1a612 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:32.725992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d5cca-90a2-4a90-9c71-17f328c1a612 None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/29d8f357765e4b46887c9cf7242de24f/roles/66779f51859f47aa886ee36ac8501a65` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:32.726567 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ebfd1-a078-4be5-a9cb-672a694af0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:32.727187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ebfd1-a078-4be5-a9cb-672a694af0a0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:32.727470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ebfd1-a078-4be5-a9cb-672a694af0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:32.727741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ebfd1-a078-4be5-a9cb-672a694af0a0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:32.728330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ebfd1-a078-4be5-a9cb-672a694af0a0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:32.729688 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ebfd1-a078-4be5-a9cb-672a694af0a0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b79ebfd1-a078-4be5-a9cb-672a694af0a0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:32.738305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:32.739316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:32.740137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 417/829] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:12:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:32.740947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ebfd1-a078-4be5-a9cb-672a694af0a0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:32.742947 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d5cca-90a2-4a90-9c71-17f328c1a612 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=29d8f357765e4b46887c9cf7242de24f, role_id=66779f51859f47aa886ee36ac8501a65)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:32.744480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d5cca-90a2-4a90-9c71-17f328c1a612 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:32.802213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:32.835118 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 413/830] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:12:32 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/29d8f357765e4b46887c9cf7242de24f/roles/66779f51859f47aa886ee36ac8501a65 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:12:32.836282 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708c37d-6497-4ad7-b633-fab796f66f62 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:32.836563 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708c37d-6497-4ad7-b633-fab796f66f62 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:32.836831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708c37d-6497-4ad7-b633-fab796f66f62 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:32.838135 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 414/831] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:32.838878 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708c37d-6497-4ad7-b633-fab796f66f62 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:32.849143 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ebfd1-a078-4be5-a9cb-672a694af0a0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:32.887415 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:32.891586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01f64c-891a-4019-a22c-2b83f0ba6ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:32.892233 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01f64c-891a-4019-a22c-2b83f0ba6ddd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:32.892514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01f64c-891a-4019-a22c-2b83f0ba6ddd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:32.892859 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01f64c-891a-4019-a22c-2b83f0ba6ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:32.906748 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01f64c-891a-4019-a22c-2b83f0ba6ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:32.908320 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01f64c-891a-4019-a22c-2b83f0ba6ddd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6b01f64c-891a-4019-a22c-2b83f0ba6ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:32.924366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:32.925715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:32.926851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:32.926851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:32.926851 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:32.930258 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 418/832] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:32.931615 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7092ac9-100b-4e2e-a501-999726241a95 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:32.931958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7092ac9-100b-4e2e-a501-999726241a95 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:32.932242 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7092ac9-100b-4e2e-a501-999726241a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:32.953226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e7092ac9-100b-4e2e-a501-999726241a95 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:32.954616 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e7092ac9-100b-4e2e-a501-999726241a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:32.964916 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b708c37d-6497-4ad7-b633-fab796f66f62 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:33.014731 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262b303-47b2-4071-880f-7f53a3b55c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:33.015708 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262b303-47b2-4071-880f-7f53a3b55c4c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:33.016155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262b303-47b2-4071-880f-7f53a3b55c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:33.016979 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262b303-47b2-4071-880f-7f53a3b55c4c None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:33.017770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262b303-47b2-4071-880f-7f53a3b55c4c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:33.018510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262b303-47b2-4071-880f-7f53a3b55c4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:33.020513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262b303-47b2-4071-880f-7f53a3b55c4c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:33.025874 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 415/833] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:12:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:33.030285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262b303-47b2-4071-880f-7f53a3b55c4c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:33.036042 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 419/834] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:33.036884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7092ac9-100b-4e2e-a501-999726241a95 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:33.097860 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:33.156685 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7092ac9-100b-4e2e-a501-999726241a95 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:33.160238 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262b303-47b2-4071-880f-7f53a3b55c4c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:33.161849 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:33.196376 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9de2dd-644e-4565-adc0-a849d76cc852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:33.196975 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9de2dd-644e-4565-adc0-a849d76cc852 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:33.197254 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9de2dd-644e-4565-adc0-a849d76cc852 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:33.197525 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9de2dd-644e-4565-adc0-a849d76cc852 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:33.198174 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9de2dd-644e-4565-adc0-a849d76cc852 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:33.198475 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9de2dd-644e-4565-adc0-a849d76cc852 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:33.199874 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9de2dd-644e-4565-adc0-a849d76cc852 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:33.201124 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5ed48-8789-4114-9eb1-5e841ac56bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:33.201899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5ed48-8789-4114-9eb1-5e841ac56bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:33.202358 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5ed48-8789-4114-9eb1-5e841ac56bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:33.202824 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5ed48-8789-4114-9eb1-5e841ac56bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:33.203604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5ed48-8789-4114-9eb1-5e841ac56bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:33.204046 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5ed48-8789-4114-9eb1-5e841ac56bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:33.205064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 420/835] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:12:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:33.205863 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a5ed48-8789-4114-9eb1-5e841ac56bb3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:33.220872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 416/836] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:33.226139 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9de2dd-644e-4565-adc0-a849d76cc852 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:33.344928 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9de2dd-644e-4565-adc0-a849d76cc852 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:33.355523 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:33.359906 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5ed48-8789-4114-9eb1-5e841ac56bb3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:33.382703 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6441ee5-520f-4219-8330-b6f53f21171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:33.383362 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6441ee5-520f-4219-8330-b6f53f21171c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:33.383601 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6441ee5-520f-4219-8330-b6f53f21171c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:33.383870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6441ee5-520f-4219-8330-b6f53f21171c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:33.391416 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6441ee5-520f-4219-8330-b6f53f21171c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:33.392133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6441ee5-520f-4219-8330-b6f53f21171c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f6441ee5-520f-4219-8330-b6f53f21171c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:33.411884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:33.412835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:33.413708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:33.413708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:33.413708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:33.413708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:33.413708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:33.413708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:33.413708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:33.413708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:33.413708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 421/837] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:33.418992 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6441ee5-520f-4219-8330-b6f53f21171c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:33.488993 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a5ed48-8789-4114-9eb1-5e841ac56bb3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:33.534800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736e0f-9b5a-405a-be8a-96f28e319caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:33.536246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736e0f-9b5a-405a-be8a-96f28e319caa None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:33.536990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736e0f-9b5a-405a-be8a-96f28e319caa None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:33.537484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63736e0f-9b5a-405a-be8a-96f28e319caa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:33.549396 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6441ee5-520f-4219-8330-b6f53f21171c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:33.551788 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63736e0f-9b5a-405a-be8a-96f28e319caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-63736e0f-9b5a-405a-be8a-96f28e319caa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:33.558880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:33.559837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:12:33.560660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:33.566172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 417/838] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:33.569290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736e0f-9b5a-405a-be8a-96f28e319caa None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:33.606077 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:33.609254 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434816ec-53e1-49bf-9b62-d2b9d26911a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:33.609863 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434816ec-53e1-49bf-9b62-d2b9d26911a4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:33.610380 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434816ec-53e1-49bf-9b62-d2b9d26911a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:33.610664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434816ec-53e1-49bf-9b62-d2b9d26911a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:33.611749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434816ec-53e1-49bf-9b62-d2b9d26911a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:33.612155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434816ec-53e1-49bf-9b62-d2b9d26911a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:33.613901 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434816ec-53e1-49bf-9b62-d2b9d26911a4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:33.630598 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 422/839] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:33.636084 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434816ec-53e1-49bf-9b62-d2b9d26911a4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:33.674929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:33.704174 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63736e0f-9b5a-405a-be8a-96f28e319caa None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:33.742092 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eacbc4-b2a2-4a80-899b-96048744998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:33.742733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eacbc4-b2a2-4a80-899b-96048744998d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:33.743080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eacbc4-b2a2-4a80-899b-96048744998d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:33.743270 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eacbc4-b2a2-4a80-899b-96048744998d None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:33.743940 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eacbc4-b2a2-4a80-899b-96048744998d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:33.744298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eacbc4-b2a2-4a80-899b-96048744998d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:33.745784 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eacbc4-b2a2-4a80-899b-96048744998d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:33.759920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 418/840] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:12:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:33.761004 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eacbc4-b2a2-4a80-899b-96048744998d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:33.774056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434816ec-53e1-49bf-9b62-d2b9d26911a4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:33.813963 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bed976-d595-4c59-b89b-5f127b8d7693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:33.814591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bed976-d595-4c59-b89b-5f127b8d7693 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:33.814873 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bed976-d595-4c59-b89b-5f127b8d7693 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:33.815146 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bed976-d595-4c59-b89b-5f127b8d7693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:33.816030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bed976-d595-4c59-b89b-5f127b8d7693 None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=bb99f54d9320496cbcc52d535fa64789) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:33.816392 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bed976-d595-4c59-b89b-5f127b8d7693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:33.817840 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bed976-d595-4c59-b89b-5f127b8d7693 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:33.826321 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 423/841] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:33 2022] GET /identity/v3/role_assignments?user.id=bb99f54d9320496cbcc52d535fa64789&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=afe88bc03d30494b89892587177c79de => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:33.867461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:33.885432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eacbc4-b2a2-4a80-899b-96048744998d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:33.927156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97d935-ada1-4f51-a2a2-264b54d26a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:33.928198 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97d935-ada1-4f51-a2a2-264b54d26a96 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:33.928692 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97d935-ada1-4f51-a2a2-264b54d26a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:33.929200 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97d935-ada1-4f51-a2a2-264b54d26a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:33.946701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97d935-ada1-4f51-a2a2-264b54d26a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:33.948194 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97d935-ada1-4f51-a2a2-264b54d26a96 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-cf97d935-ada1-4f51-a2a2-264b54d26a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:33.966205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:33.967290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:33.968211 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:33.968211 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:33.968211 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:33.968211 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 419/842] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:33.973431 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bed976-d595-4c59-b89b-5f127b8d7693 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:34.074852 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:34.083542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bed976-d595-4c59-b89b-5f127b8d7693 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:34.118986 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc3d31-ed3e-4717-9e76-3067309babeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:34.119809 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3d31-ed3e-4717-9e76-3067309babeb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:34.120231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3d31-ed3e-4717-9e76-3067309babeb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:34.120641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc3d31-ed3e-4717-9e76-3067309babeb None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:34.121428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc3d31-ed3e-4717-9e76-3067309babeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:34.121888 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc3d31-ed3e-4717-9e76-3067309babeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:34.123419 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc3d31-ed3e-4717-9e76-3067309babeb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:34.136331 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 424/843] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:34.146120 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97d935-ada1-4f51-a2a2-264b54d26a96 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:34.244927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97d935-ada1-4f51-a2a2-264b54d26a96 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:34.282522 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae5b8f-7d3b-4837-a3db-42e3cf39e0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:34.283163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5b8f-7d3b-4837-a3db-42e3cf39e0cd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:34.283442 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5b8f-7d3b-4837-a3db-42e3cf39e0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:34.283713 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5b8f-7d3b-4837-a3db-42e3cf39e0cd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:34.286580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:34.292531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae5b8f-7d3b-4837-a3db-42e3cf39e0cd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:34.293983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae5b8f-7d3b-4837-a3db-42e3cf39e0cd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8bae5b8f-7d3b-4837-a3db-42e3cf39e0cd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:34.306230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:34.310062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:34.311014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:34.311014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:34.311014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:34.311014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:34.311014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:34.311014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:34.311014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:34.311014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:34.311014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 07:12:34.311014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:34.311014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 420/844] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:12:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:34.314263 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc3d31-ed3e-4717-9e76-3067309babeb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:34.421632 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc3d31-ed3e-4717-9e76-3067309babeb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:34.457137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef928b1b-25ef-44f3-b7ec-42cc7749321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:34.457985 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef928b1b-25ef-44f3-b7ec-42cc7749321a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:34.458430 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef928b1b-25ef-44f3-b7ec-42cc7749321a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:34.458875 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef928b1b-25ef-44f3-b7ec-42cc7749321a None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:34.459812 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef928b1b-25ef-44f3-b7ec-42cc7749321a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:34.460315 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef928b1b-25ef-44f3-b7ec-42cc7749321a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:34.461888 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef928b1b-25ef-44f3-b7ec-42cc7749321a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:34.480997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 425/845] 10.222.0.16 () {56 vars in 1135 bytes} [Tue Aug 23 07:12:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:34.487625 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae5b8f-7d3b-4837-a3db-42e3cf39e0cd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:34.603609 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae5b8f-7d3b-4837-a3db-42e3cf39e0cd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:34.638451 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdcebb-71d2-42db-a0fc-c75243230904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:34.639055 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcebb-71d2-42db-a0fc-c75243230904 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:34.639335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcebb-71d2-42db-a0fc-c75243230904 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:34.639605 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdcebb-71d2-42db-a0fc-c75243230904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:34.704823 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:34.712217 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdcebb-71d2-42db-a0fc-c75243230904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:34.713685 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdcebb-71d2-42db-a0fc-c75243230904 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:34.818539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 421/846] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:34 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:12:34.824251 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef928b1b-25ef-44f3-b7ec-42cc7749321a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:34.838430 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7fd1-d04e-4922-8d71-6f22c1866b90 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:34.838712 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7fd1-d04e-4922-8d71-6f22c1866b90 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:34.838991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f7fd1-d04e-4922-8d71-6f22c1866b90 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:34.840824 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 422/847] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:34.846351 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285030f5-83b7-4994-a7a7-e94b8e013980 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:34.846638 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285030f5-83b7-4994-a7a7-e94b8e013980 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:34.846913 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285030f5-83b7-4994-a7a7-e94b8e013980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:34.854442 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:34.867695 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-285030f5-83b7-4994-a7a7-e94b8e013980 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:34.868945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-285030f5-83b7-4994-a7a7-e94b8e013980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:34.939782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef928b1b-25ef-44f3-b7ec-42cc7749321a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:34.949114 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 423/848] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:34 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:12:34.982778 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6d411-14a4-42fa-8d51-f048ee08a962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:34.983326 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d411-14a4-42fa-8d51-f048ee08a962 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:34.984282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d411-14a4-42fa-8d51-f048ee08a962 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:34.984695 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6d411-14a4-42fa-8d51-f048ee08a962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:34.995561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6d411-14a4-42fa-8d51-f048ee08a962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:34.997005 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6d411-14a4-42fa-8d51-f048ee08a962 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-59b6d411-14a4-42fa-8d51-f048ee08a962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:35.013421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:35.014517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:35.015572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:35.015572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:35.015572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:35.015572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 426/849] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:35.021864 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285030f5-83b7-4994-a7a7-e94b8e013980 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:35.058994 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:35.126829 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285030f5-83b7-4994-a7a7-e94b8e013980 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:35.162424 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cd709-c2a9-4089-8026-8657ef1c4cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:35.163029 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cd709-c2a9-4089-8026-8657ef1c4cac None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:35.163304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cd709-c2a9-4089-8026-8657ef1c4cac None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:35.163572 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cd709-c2a9-4089-8026-8657ef1c4cac None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:35.164209 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cd709-c2a9-4089-8026-8657ef1c4cac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:35.164506 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cd709-c2a9-4089-8026-8657ef1c4cac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:35.165859 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cd709-c2a9-4089-8026-8657ef1c4cac None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:35.177665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 424/850] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:35.187685 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6d411-14a4-42fa-8d51-f048ee08a962 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:35.232685 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cd709-c2a9-4089-8026-8657ef1c4cac None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:35.257447 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:35.315607 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6d411-14a4-42fa-8d51-f048ee08a962 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:35.334223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:35.355528 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cd709-c2a9-4089-8026-8657ef1c4cac None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:35.357391 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39516a74-0513-4923-a55b-b58a7858aa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:35.358029 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39516a74-0513-4923-a55b-b58a7858aa27 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:35.358337 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39516a74-0513-4923-a55b-b58a7858aa27 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:35.358642 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39516a74-0513-4923-a55b-b58a7858aa27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:35.365941 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39516a74-0513-4923-a55b-b58a7858aa27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:35.367196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39516a74-0513-4923-a55b-b58a7858aa27 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-39516a74-0513-4923-a55b-b58a7858aa27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:35.379814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:35.380929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:35.381842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:35.381842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:35.381842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:35.381842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:35.381842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:35.381842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:35.381842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:35.381842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:35.381842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 427/851] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:35.382380 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c194d54-64c1-4069-8933-a08028bc337a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:35.382459 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c194d54-64c1-4069-8933-a08028bc337a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:35.382701 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c194d54-64c1-4069-8933-a08028bc337a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:35.384070 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 428/852] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:35.388803 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c194d54-64c1-4069-8933-a08028bc337a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:35.404952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda082e2-ceb9-4acf-be9c-04324b2f4d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:35.406349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda082e2-ceb9-4acf-be9c-04324b2f4d05 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:35.406642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda082e2-ceb9-4acf-be9c-04324b2f4d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:35.406915 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda082e2-ceb9-4acf-be9c-04324b2f4d05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:35.418585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda082e2-ceb9-4acf-be9c-04324b2f4d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-dda082e2-ceb9-4acf-be9c-04324b2f4d05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:35.424025 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:35.424938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:35.425783 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 425/853] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:12:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:35.427031 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64716e3c-3343-4f04-98b6-56b9efa7ff18 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:35.427031 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64716e3c-3343-4f04-98b6-56b9efa7ff18 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:35.427031 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64716e3c-3343-4f04-98b6-56b9efa7ff18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:35.445374 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-64716e3c-3343-4f04-98b6-56b9efa7ff18 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:35.446797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-64716e3c-3343-4f04-98b6-56b9efa7ff18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:35.503981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c194d54-64c1-4069-8933-a08028bc337a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:35.522287 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 426/854] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:35.522287 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64716e3c-3343-4f04-98b6-56b9efa7ff18 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:35.533605 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:35.555251 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39084d8-fb87-418c-a9be-cb7f33590f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:35.555863 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39084d8-fb87-418c-a9be-cb7f33590f83 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:35.556142 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39084d8-fb87-418c-a9be-cb7f33590f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:35.556413 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39084d8-fb87-418c-a9be-cb7f33590f83 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:35.557117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39084d8-fb87-418c-a9be-cb7f33590f83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:35.557420 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39084d8-fb87-418c-a9be-cb7f33590f83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:35.558931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39084d8-fb87-418c-a9be-cb7f33590f83 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:35.576760 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 429/855] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:35.578465 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39084d8-fb87-418c-a9be-cb7f33590f83 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:35.637077 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:35.664222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64716e3c-3343-4f04-98b6-56b9efa7ff18 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:35.691777 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39084d8-fb87-418c-a9be-cb7f33590f83 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:35.702113 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6458b2-9363-4817-a07b-5c2d9bb10e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:35.703737 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6458b2-9363-4817-a07b-5c2d9bb10e7e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:35.704225 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6458b2-9363-4817-a07b-5c2d9bb10e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:35.704721 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6458b2-9363-4817-a07b-5c2d9bb10e7e None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:35.705641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6458b2-9363-4817-a07b-5c2d9bb10e7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:35.706226 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6458b2-9363-4817-a07b-5c2d9bb10e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:35.707911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6458b2-9363-4817-a07b-5c2d9bb10e7e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:35.722184 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 427/856] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:12:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:35.723605 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6458b2-9363-4817-a07b-5c2d9bb10e7e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:35.728706 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3bd97-9237-4cde-af35-a75753fe1515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:35.729025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3bd97-9237-4cde-af35-a75753fe1515 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:35.729312 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3bd97-9237-4cde-af35-a75753fe1515 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:35.729583 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa3bd97-9237-4cde-af35-a75753fe1515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:35.730342 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3bd97-9237-4cde-af35-a75753fe1515 None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=b115a3ce93804ddbaf542934addb506b) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:35.730654 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3bd97-9237-4cde-af35-a75753fe1515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:35.732091 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa3bd97-9237-4cde-af35-a75753fe1515 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:35.742151 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 430/857] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:35 2022] GET /identity/v3/role_assignments?user.id=b115a3ce93804ddbaf542934addb506b&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=afe88bc03d30494b89892587177c79de => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:35.796796 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3bd97-9237-4cde-af35-a75753fe1515 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:35.860535 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6458b2-9363-4817-a07b-5c2d9bb10e7e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:35.870497 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:35.904997 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab868d3b-1955-45a9-98e9-8e287eb78939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:35.905831 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab868d3b-1955-45a9-98e9-8e287eb78939 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:35.906127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab868d3b-1955-45a9-98e9-8e287eb78939 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:35.906423 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab868d3b-1955-45a9-98e9-8e287eb78939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:35.914758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:35.918678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab868d3b-1955-45a9-98e9-8e287eb78939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:35.920446 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab868d3b-1955-45a9-98e9-8e287eb78939 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:35.923743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa3bd97-9237-4cde-af35-a75753fe1515 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ab868d3b-1955-45a9-98e9-8e287eb78939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:35.934531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:35.935461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:35.936345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:35.936345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:35.936345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:35.936345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 428/858] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:35.937836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebc858-91f4-48d4-951f-143d98686ddc None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:35.938139 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebc858-91f4-48d4-951f-143d98686ddc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:35.938473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ebc858-91f4-48d4-951f-143d98686ddc None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:35.943651 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 429/859] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:35.943651 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebc858-91f4-48d4-951f-143d98686ddc None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:35.970707 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63d232-547d-4ede-a927-e736d862601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:35.971424 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d232-547d-4ede-a927-e736d862601c None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:35.971768 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d232-547d-4ede-a927-e736d862601c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:35.972107 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63d232-547d-4ede-a927-e736d862601c None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:35.972814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d232-547d-4ede-a927-e736d862601c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:35.974303 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63d232-547d-4ede-a927-e736d862601c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:36.049019 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 431/860] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:12:35 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:12:36.050400 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213405a-ce71-4cd2-a568-2db236455aaa None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:36.050508 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213405a-ce71-4cd2-a568-2db236455aaa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:36.050758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213405a-ce71-4cd2-a568-2db236455aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:36.063420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ebc858-91f4-48d4-951f-143d98686ddc None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:36.071703 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8213405a-ce71-4cd2-a568-2db236455aaa None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:36.073534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8213405a-ce71-4cd2-a568-2db236455aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:36.107432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08d259-8ecf-4b7e-9149-37948867ce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:36.108376 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08d259-8ecf-4b7e-9149-37948867ce8e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:36.108951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08d259-8ecf-4b7e-9149-37948867ce8e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:36.109543 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08d259-8ecf-4b7e-9149-37948867ce8e None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:36.110542 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08d259-8ecf-4b7e-9149-37948867ce8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:36.111035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08d259-8ecf-4b7e-9149-37948867ce8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:36.112706 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08d259-8ecf-4b7e-9149-37948867ce8e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:36.127767 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 430/861] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:36.134177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08d259-8ecf-4b7e-9149-37948867ce8e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:36.160745 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 432/862] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:36.189118 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:36.249902 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08d259-8ecf-4b7e-9149-37948867ce8e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:36.286822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac531ca-864e-4222-8b06-bdb45568d45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:36.287456 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac531ca-864e-4222-8b06-bdb45568d45f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:36.287733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac531ca-864e-4222-8b06-bdb45568d45f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:36.288059 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac531ca-864e-4222-8b06-bdb45568d45f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:36.297047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac531ca-864e-4222-8b06-bdb45568d45f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:36.298591 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac531ca-864e-4222-8b06-bdb45568d45f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-6ac531ca-864e-4222-8b06-bdb45568d45f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:36.310370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:36.311281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:36.313373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:36.313373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:36.313373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:36.313373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:36.313373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:36.313373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:36.313373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:36.313373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:36.313373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:36.313373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:36.313373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 431/863] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 07:12:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:36.318799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213405a-ce71-4cd2-a568-2db236455aaa None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:36.355068 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:36.424023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213405a-ce71-4cd2-a568-2db236455aaa None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:36.440905 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac531ca-864e-4222-8b06-bdb45568d45f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:36.468959 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39778b-b2bf-429e-9e64-71127f1ccad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:36.469751 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39778b-b2bf-429e-9e64-71127f1ccad7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:36.470032 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39778b-b2bf-429e-9e64-71127f1ccad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:36.470335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39778b-b2bf-429e-9e64-71127f1ccad7 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:36.471396 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39778b-b2bf-429e-9e64-71127f1ccad7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:36.471703 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39778b-b2bf-429e-9e64-71127f1ccad7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:36.473737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39778b-b2bf-429e-9e64-71127f1ccad7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:36.497163 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 433/864] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 07:12:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:36.503370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39778b-b2bf-429e-9e64-71127f1ccad7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:36.566062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac531ca-864e-4222-8b06-bdb45568d45f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:36.574890 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:36.613845 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35a18-a76a-442b-a0e0-1600fd8d3996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:36.614510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35a18-a76a-442b-a0e0-1600fd8d3996 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:36.614795 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35a18-a76a-442b-a0e0-1600fd8d3996 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:36.615588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35a18-a76a-442b-a0e0-1600fd8d3996 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:36.616194 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca35a18-a76a-442b-a0e0-1600fd8d3996 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:36.618130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca35a18-a76a-442b-a0e0-1600fd8d3996 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:36.621307 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:36.629868 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39778b-b2bf-429e-9e64-71127f1ccad7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0ca35a18-a76a-442b-a0e0-1600fd8d3996 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:36.631637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:36.635847 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:36.636716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 432/865] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 23 07:12:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:36.640718 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35a18-a76a-442b-a0e0-1600fd8d3996 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:36.672299 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfecb2d-25d1-4caa-bc36-06ddedcdcfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:36.673124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfecb2d-25d1-4caa-bc36-06ddedcdcfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:36.673506 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfecb2d-25d1-4caa-bc36-06ddedcdcfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:36.673859 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfecb2d-25d1-4caa-bc36-06ddedcdcfe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:36.755595 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfecb2d-25d1-4caa-bc36-06ddedcdcfe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:36.757263 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfecb2d-25d1-4caa-bc36-06ddedcdcfe7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:36.778964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca35a18-a76a-442b-a0e0-1600fd8d3996 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:36.817732 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dd133-48ac-411e-ae2d-2601e002c55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:36.818666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd133-48ac-411e-ae2d-2601e002c55e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:36.819096 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd133-48ac-411e-ae2d-2601e002c55e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:36.819608 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dd133-48ac-411e-ae2d-2601e002c55e None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:36.820388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dd133-48ac-411e-ae2d-2601e002c55e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:36.820837 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dd133-48ac-411e-ae2d-2601e002c55e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:36.822504 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dd133-48ac-411e-ae2d-2601e002c55e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:36.828755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 433/866] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 07:12:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:36.833933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dd133-48ac-411e-ae2d-2601e002c55e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:36.875141 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:36.885532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 434/867] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:36 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 07:12:36.886686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:36.893441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfecb2d-25d1-4caa-bc36-06ddedcdcfe7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:36.957916 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dd133-48ac-411e-ae2d-2601e002c55e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:36.993669 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c6306-da53-4589-aa29-86ff441cfafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:36.994351 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c6306-da53-4589-aa29-86ff441cfafa None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:36.994633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c6306-da53-4589-aa29-86ff441cfafa None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:36.994908 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c6306-da53-4589-aa29-86ff441cfafa None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:36.995703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c6306-da53-4589-aa29-86ff441cfafa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:36.995978 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c6306-da53-4589-aa29-86ff441cfafa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:36.997344 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3c6306-da53-4589-aa29-86ff441cfafa None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:37.006825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 434/868] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 07:12:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:37.025366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfecb2d-25d1-4caa-bc36-06ddedcdcfe7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:37.064124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64989811-034c-493d-870c-d40b1c30b909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:37.064766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64989811-034c-493d-870c-d40b1c30b909 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:37.065044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64989811-034c-493d-870c-d40b1c30b909 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:37.065324 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64989811-034c-493d-870c-d40b1c30b909 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:37.077119 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64989811-034c-493d-870c-d40b1c30b909 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:37.078632 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64989811-034c-493d-870c-d40b1c30b909 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-64989811-034c-493d-870c-d40b1c30b909 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:37.095450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:37.096446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:37.097319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:37.097319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:37.097319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:37.097319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 435/869] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:37.103273 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c6306-da53-4589-aa29-86ff441cfafa None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:37.213067 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:37.218537 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c6306-da53-4589-aa29-86ff441cfafa None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:37.255544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb790c-9e61-4545-a3e3-8c2f38b4ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:37.256517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb790c-9e61-4545-a3e3-8c2f38b4ead1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:37.257017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb790c-9e61-4545-a3e3-8c2f38b4ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:37.257501 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb790c-9e61-4545-a3e3-8c2f38b4ead1 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:37.258368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb790c-9e61-4545-a3e3-8c2f38b4ead1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:37.258862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb790c-9e61-4545-a3e3-8c2f38b4ead1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:37.260409 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffb790c-9e61-4545-a3e3-8c2f38b4ead1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:37.272318 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 435/870] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:37.278120 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64989811-034c-493d-870c-d40b1c30b909 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:37.331361 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:37.387158 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64989811-034c-493d-870c-d40b1c30b909 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:37.422486 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce2eed-9be4-4795-934a-05b81e97f7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:37.423517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce2eed-9be4-4795-934a-05b81e97f7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:37.423990 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce2eed-9be4-4795-934a-05b81e97f7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:37.424452 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce2eed-9be4-4795-934a-05b81e97f7f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:37.431589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce2eed-9be4-4795-934a-05b81e97f7f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:37.433238 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce2eed-9be4-4795-934a-05b81e97f7f9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1dce2eed-9be4-4795-934a-05b81e97f7f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:37.444914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:37.445769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:37.446694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:37.446694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:37.446694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:37.446694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:37.446694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:37.446694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:37.446694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:37.446694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:37.448949 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 436/871] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:37.459134 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb790c-9e61-4545-a3e3-8c2f38b4ead1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:37.566904 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb790c-9e61-4545-a3e3-8c2f38b4ead1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:37.604126 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed777d-0584-4bbd-853d-0e7cb6d3a7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:37.604734 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed777d-0584-4bbd-853d-0e7cb6d3a7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:37.605010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed777d-0584-4bbd-853d-0e7cb6d3a7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:37.605277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed777d-0584-4bbd-853d-0e7cb6d3a7f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:37.605961 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed777d-0584-4bbd-853d-0e7cb6d3a7f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:37.606300 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed777d-0584-4bbd-853d-0e7cb6d3a7f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:37.607817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed777d-0584-4bbd-853d-0e7cb6d3a7f5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:37.621313 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 436/872] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:37.631176 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce2eed-9be4-4795-934a-05b81e97f7f9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:37.741062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce2eed-9be4-4795-934a-05b81e97f7f9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:37.748338 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:37.778595 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6d44d-3d40-4b94-ba82-28dc8898b5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:37.779194 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6d44d-3d40-4b94-ba82-28dc8898b5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:37.779471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6d44d-3d40-4b94-ba82-28dc8898b5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:37.779738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6d44d-3d40-4b94-ba82-28dc8898b5f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:37.781188 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6d44d-3d40-4b94-ba82-28dc8898b5f4 None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=29d8f357765e4b46887c9cf7242de24f) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:37.781705 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6d44d-3d40-4b94-ba82-28dc8898b5f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:37.783155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6d44d-3d40-4b94-ba82-28dc8898b5f4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:37.789821 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 437/873] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:37 2022] GET /identity/v3/role_assignments?user.id=29d8f357765e4b46887c9cf7242de24f&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:37.796097 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a041d6-4e95-4453-bf2d-46ea497d882a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:37.797180 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a041d6-4e95-4453-bf2d-46ea497d882a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:37.797669 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a041d6-4e95-4453-bf2d-46ea497d882a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:37.799778 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 437/874] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:37.805952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379476-751f-4b47-b3d6-b2c14f896a78 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:37.806303 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379476-751f-4b47-b3d6-b2c14f896a78 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:37.806531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d379476-751f-4b47-b3d6-b2c14f896a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:37.826196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-9d379476-751f-4b47-b3d6-b2c14f896a78 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:37.828153 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-9d379476-751f-4b47-b3d6-b2c14f896a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:37.903175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 438/875] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:38.155933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fddb84-1759-430c-a305-370a71ae0dc6 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:38.155933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fddb84-1759-430c-a305-370a71ae0dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:38.155933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fddb84-1759-430c-a305-370a71ae0dc6 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:38.156562 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 438/876] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:38.162460 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa632a-e8f4-4766-8ab0-72c889816648 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:38.163091 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa632a-e8f4-4766-8ab0-72c889816648 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:38.163563 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa632a-e8f4-4766-8ab0-72c889816648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:38.177757 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fddb84-1759-430c-a305-370a71ae0dc6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:38.184712 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-78aa632a-e8f4-4766-8ab0-72c889816648 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:38.185889 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-78aa632a-e8f4-4766-8ab0-72c889816648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:38.200761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:38.267692 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 439/877] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:38 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:38.307825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fddb84-1759-430c-a305-370a71ae0dc6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:38.345045 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118b2f5-b911-4951-8950-d96bf5b4e1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:38.346077 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118b2f5-b911-4951-8950-d96bf5b4e1ce None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:38.346523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118b2f5-b911-4951-8950-d96bf5b4e1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:38.346969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118b2f5-b911-4951-8950-d96bf5b4e1ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:38.347677 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118b2f5-b911-4951-8950-d96bf5b4e1ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:38.349236 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118b2f5-b911-4951-8950-d96bf5b4e1ce None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e118b2f5-b911-4951-8950-d96bf5b4e1ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:38.359032 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:38.360368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:38.361414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:38.363855 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 439/878] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 07:12:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:38.369762 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa632a-e8f4-4766-8ab0-72c889816648 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:38.404526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:38.476766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa632a-e8f4-4766-8ab0-72c889816648 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:38.513807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16d9ce-9f4f-4bda-aab6-fffd8efba650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:38.514493 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16d9ce-9f4f-4bda-aab6-fffd8efba650 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:38.515085 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16d9ce-9f4f-4bda-aab6-fffd8efba650 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:38.515503 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16d9ce-9f4f-4bda-aab6-fffd8efba650 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:38.516148 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16d9ce-9f4f-4bda-aab6-fffd8efba650 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:38.516451 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16d9ce-9f4f-4bda-aab6-fffd8efba650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:38.517820 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16d9ce-9f4f-4bda-aab6-fffd8efba650 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:38.522935 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 440/879] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 07:12:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:38.528358 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118b2f5-b911-4951-8950-d96bf5b4e1ce None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:38.567430 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16d9ce-9f4f-4bda-aab6-fffd8efba650 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:38.637750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:38.668796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118b2f5-b911-4951-8950-d96bf5b4e1ce None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:38.688676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:38.699015 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16d9ce-9f4f-4bda-aab6-fffd8efba650 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:38.713482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a8f0b-658c-4a5e-833a-5b14d8c1a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:38.714636 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8f0b-658c-4a5e-833a-5b14d8c1a502 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:38.715121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8f0b-658c-4a5e-833a-5b14d8c1a502 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:38.715613 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a8f0b-658c-4a5e-833a-5b14d8c1a502 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:38.716470 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a8f0b-658c-4a5e-833a-5b14d8c1a502 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:38.717000 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a8f0b-658c-4a5e-833a-5b14d8c1a502 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:38.719201 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a8f0b-658c-4a5e-833a-5b14d8c1a502 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:38.724802 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 440/880] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 07:12:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:38.737939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4614-1d85-407d-bccb-89476231b46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:38.738536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4614-1d85-407d-bccb-89476231b46b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:38.738820 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4614-1d85-407d-bccb-89476231b46b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:38.739095 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e4614-1d85-407d-bccb-89476231b46b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:38.739698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e4614-1d85-407d-bccb-89476231b46b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:38.741127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e4614-1d85-407d-bccb-89476231b46b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-df3e4614-1d85-407d-bccb-89476231b46b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:38.751333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:38.752411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:38.753226 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 441/881] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:12:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:38.759021 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a8f0b-658c-4a5e-833a-5b14d8c1a502 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:38.871930 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a8f0b-658c-4a5e-833a-5b14d8c1a502 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:38.908311 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2d66f6-f1b6-4852-bc5a-29faa8d76950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:38.908925 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d66f6-f1b6-4852-bc5a-29faa8d76950 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:38.909303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d66f6-f1b6-4852-bc5a-29faa8d76950 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:38.909664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2d66f6-f1b6-4852-bc5a-29faa8d76950 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:38.910519 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d66f6-f1b6-4852-bc5a-29faa8d76950 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:38.910777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d66f6-f1b6-4852-bc5a-29faa8d76950 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:38.912317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2d66f6-f1b6-4852-bc5a-29faa8d76950 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:38.917965 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 441/882] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:12:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:38.923915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4614-1d85-407d-bccb-89476231b46b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:39.018575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af41dd-8f97-457b-9f4c-090e32c6373f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:39.019181 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af41dd-8f97-457b-9f4c-090e32c6373f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:39.019653 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af41dd-8f97-457b-9f4c-090e32c6373f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:39.021435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 442/883] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:39.026454 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c9e7-03bf-4e4f-932a-3c8920724333 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:39.026746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c9e7-03bf-4e4f-932a-3c8920724333 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:39.027017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341c9e7-03bf-4e4f-932a-3c8920724333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:39.034832 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e4614-1d85-407d-bccb-89476231b46b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:39.050371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-0341c9e7-03bf-4e4f-932a-3c8920724333 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:39.051717 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-0341c9e7-03bf-4e4f-932a-3c8920724333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:39.055219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:39.073125 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e815cb-c7b7-4761-8c6b-33813d036f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:39.073671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e815cb-c7b7-4761-8c6b-33813d036f09 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:39.073951 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e815cb-c7b7-4761-8c6b-33813d036f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:39.074258 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e815cb-c7b7-4761-8c6b-33813d036f09 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:39.074909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e815cb-c7b7-4761-8c6b-33813d036f09 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:39.075213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e815cb-c7b7-4761-8c6b-33813d036f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:39.076592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e815cb-c7b7-4761-8c6b-33813d036f09 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:39.082274 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 442/884] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:12:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:39.087918 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e815cb-c7b7-4761-8c6b-33813d036f09 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:39.114514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:39.132459 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 443/885] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:12:39.192310 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e815cb-c7b7-4761-8c6b-33813d036f09 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:39.228772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ad49e-d6b9-4ccb-8c1c-339434c1cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:39.229374 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ad49e-d6b9-4ccb-8c1c-339434c1cba9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:39.229656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ad49e-d6b9-4ccb-8c1c-339434c1cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:39.229930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ad49e-d6b9-4ccb-8c1c-339434c1cba9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:39.230659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ad49e-d6b9-4ccb-8c1c-339434c1cba9 None admin] RBAC: Adding query filter params (interface=public, service_id=2df8e363331144dd889244e25784929a, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:39.230971 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ad49e-d6b9-4ccb-8c1c-339434c1cba9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:39.232338 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ad49e-d6b9-4ccb-8c1c-339434c1cba9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:39.238217 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 443/886] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 07:12:39 2022] GET /identity/v3/endpoints?service_id=2df8e363331144dd889244e25784929a&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:39.243702 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341c9e7-03bf-4e4f-932a-3c8920724333 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:39.357606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341c9e7-03bf-4e4f-932a-3c8920724333 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:39.397114 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8179436-367b-4fc6-a2ce-6bd67628254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:39.398089 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8179436-367b-4fc6-a2ce-6bd67628254a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:39.398614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8179436-367b-4fc6-a2ce-6bd67628254a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:39.399099 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8179436-367b-4fc6-a2ce-6bd67628254a None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:39.399894 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8179436-367b-4fc6-a2ce-6bd67628254a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:39.401457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8179436-367b-4fc6-a2ce-6bd67628254a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:39.402499 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ad49e-d6b9-4ccb-8c1c-339434c1cba9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:39.408740 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 444/887] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 07:12:39 2022] GET /identity/v3/services => generated 1011 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 07:12:39.525519 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ad49e-d6b9-4ccb-8c1c-339434c1cba9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:39.527248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:39.564357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9baf621-1c00-413e-9c6d-169c979a5401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:39.564959 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf621-1c00-413e-9c6d-169c979a5401 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:39.565249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf621-1c00-413e-9c6d-169c979a5401 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:39.565663 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9baf621-1c00-413e-9c6d-169c979a5401 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:39.566449 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baf621-1c00-413e-9c6d-169c979a5401 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:39.568145 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9baf621-1c00-413e-9c6d-169c979a5401 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:39.672729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 444/888] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:12:39 2022] POST /identity/v3/services => generated 269 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:39.916508 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2228-0a7f-4538-a7f4-566863bf644a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:39.917016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2228-0a7f-4538-a7f4-566863bf644a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:39.917094 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b2228-0a7f-4538-a7f4-566863bf644a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:39.918674 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 445/889] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:39.924160 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb3626-04c8-4abe-96b8-77d586799d3d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:39.924410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb3626-04c8-4abe-96b8-77d586799d3d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:39.924643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb3626-04c8-4abe-96b8-77d586799d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:39.943022 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4abb3626-04c8-4abe-96b8-77d586799d3d None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:39.944211 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4abb3626-04c8-4abe-96b8-77d586799d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:40.018478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 445/890] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:40.287827 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2228-0a7f-4538-a7f4-566863bf644a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:40.292664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:40.399941 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b2228-0a7f-4538-a7f4-566863bf644a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:40.437001 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d73aae-24f2-4770-9696-c3ec2d62e213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:40.437633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73aae-24f2-4770-9696-c3ec2d62e213 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:40.437908 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73aae-24f2-4770-9696-c3ec2d62e213 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:40.438209 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d73aae-24f2-4770-9696-c3ec2d62e213 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:40.449097 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d73aae-24f2-4770-9696-c3ec2d62e213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e5d73aae-24f2-4770-9696-c3ec2d62e213 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:40.454130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:40.455056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:40.455886 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 446/891] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 07:12:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:40.461138 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb3626-04c8-4abe-96b8-77d586799d3d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:40.536591 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:40.568154 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb3626-04c8-4abe-96b8-77d586799d3d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:40.617637 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f57cd-5de1-4662-b9aa-37883a6e7de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:40.618263 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f57cd-5de1-4662-b9aa-37883a6e7de5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:40.618537 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f57cd-5de1-4662-b9aa-37883a6e7de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:40.618803 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f57cd-5de1-4662-b9aa-37883a6e7de5 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:40.619458 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f57cd-5de1-4662-b9aa-37883a6e7de5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:40.619750 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f57cd-5de1-4662-b9aa-37883a6e7de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:40.621102 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f57cd-5de1-4662-b9aa-37883a6e7de5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:40.629480 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 446/892] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 07:12:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:40.635093 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d73aae-24f2-4770-9696-c3ec2d62e213 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:40.700058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:40.747497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d73aae-24f2-4770-9696-c3ec2d62e213 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:40.787316 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d50287-6c33-4614-9ae2-eec796379cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:40.787943 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d50287-6c33-4614-9ae2-eec796379cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:40.788223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d50287-6c33-4614-9ae2-eec796379cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:40.788493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d50287-6c33-4614-9ae2-eec796379cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:40.799548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d50287-6c33-4614-9ae2-eec796379cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:40.800999 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d50287-6c33-4614-9ae2-eec796379cb7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-68d50287-6c33-4614-9ae2-eec796379cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:40.815828 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:40.816838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:40.817713 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:40.817713 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:40.817713 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:40.817883 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e04ffa-c889-4f73-8b59-f91c90d62b32 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:40.817964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 447/893] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:40.818035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e04ffa-c889-4f73-8b59-f91c90d62b32 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:40.818035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e04ffa-c889-4f73-8b59-f91c90d62b32 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:40.819348 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 447/894] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:40.828725 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d50287-6c33-4614-9ae2-eec796379cb7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:40.829102 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20c53b-be1c-4b33-8483-112df8fe20fa None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:40.829102 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20c53b-be1c-4b33-8483-112df8fe20fa None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:40.829102 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20c53b-be1c-4b33-8483-112df8fe20fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:40.846195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8e20c53b-be1c-4b33-8483-112df8fe20fa None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:40.847705 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8e20c53b-be1c-4b33-8483-112df8fe20fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:40.926380 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 448/895] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:12:40.931387 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d50287-6c33-4614-9ae2-eec796379cb7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:40.952978 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:40.967317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe285c-8bb1-4684-9019-573123d6cdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:40.968151 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe285c-8bb1-4684-9019-573123d6cdde None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:40.968427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe285c-8bb1-4684-9019-573123d6cdde None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:40.968700 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe285c-8bb1-4684-9019-573123d6cdde None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:40.969339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe285c-8bb1-4684-9019-573123d6cdde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:40.969639 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe285c-8bb1-4684-9019-573123d6cdde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:40.971023 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe285c-8bb1-4684-9019-573123d6cdde None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:40.987701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 448/896] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:40.991291 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20c53b-be1c-4b33-8483-112df8fe20fa None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:41.056488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:41.102578 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20c53b-be1c-4b33-8483-112df8fe20fa None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:41.137862 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064309e6-a280-4d14-ae1b-9a7ccbaf3084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:41.138915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064309e6-a280-4d14-ae1b-9a7ccbaf3084 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:41.139200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064309e6-a280-4d14-ae1b-9a7ccbaf3084 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:41.140045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064309e6-a280-4d14-ae1b-9a7ccbaf3084 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:41.151264 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064309e6-a280-4d14-ae1b-9a7ccbaf3084 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:41.152690 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064309e6-a280-4d14-ae1b-9a7ccbaf3084 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-064309e6-a280-4d14-ae1b-9a7ccbaf3084 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:41.164014 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:41.164964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:41.165877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:41.165877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:41.165877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:41.165877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:41.165877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:41.165877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:41.165877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:41.165877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:41.165877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:41.165877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:41.165877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 449/897] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 07:12:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:41.171143 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe285c-8bb1-4684-9019-573123d6cdde None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:41.223894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064309e6-a280-4d14-ae1b-9a7ccbaf3084 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:41.275515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe285c-8bb1-4684-9019-573123d6cdde None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:41.311548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099b536-0a64-4cbb-adc8-3daaca3ae691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:41.312336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099b536-0a64-4cbb-adc8-3daaca3ae691 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:41.312750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099b536-0a64-4cbb-adc8-3daaca3ae691 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:41.313024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099b536-0a64-4cbb-adc8-3daaca3ae691 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:41.313753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099b536-0a64-4cbb-adc8-3daaca3ae691 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:41.314251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099b536-0a64-4cbb-adc8-3daaca3ae691 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:41.316553 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099b536-0a64-4cbb-adc8-3daaca3ae691 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:41.340307 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064309e6-a280-4d14-ae1b-9a7ccbaf3084 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:41.342216 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 449/898] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 07:12:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:41.345236 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099b536-0a64-4cbb-adc8-3daaca3ae691 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:41.370267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:41.381399 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:41.384882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9624c2-d00f-42c2-8d15-1901cbf12245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:41.385483 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9624c2-d00f-42c2-8d15-1901cbf12245 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:41.385757 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9624c2-d00f-42c2-8d15-1901cbf12245 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:41.386081 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9624c2-d00f-42c2-8d15-1901cbf12245 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:41.390711 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9624c2-d00f-42c2-8d15-1901cbf12245 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:41.390711 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9624c2-d00f-42c2-8d15-1901cbf12245 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:41.446901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099b536-0a64-4cbb-adc8-3daaca3ae691 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:41.465884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 450/899] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:12:41 2022] POST /identity/v3/services => generated 241 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:41.468367 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce17fd-3976-40f6-ba2a-12f53464e06d None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:41.469869 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce17fd-3976-40f6-ba2a-12f53464e06d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:41.470455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce17fd-3976-40f6-ba2a-12f53464e06d None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:41.476473 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 451/900] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:41.478087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bc4dd-5b12-42fa-9158-d9993495cb17 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:41.478456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bc4dd-5b12-42fa-9158-d9993495cb17 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:41.478728 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bc4dd-5b12-42fa-9158-d9993495cb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:41.494632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6664674-1be3-40cf-b090-8317f536a6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:41.495632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664674-1be3-40cf-b090-8317f536a6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:41.496092 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664674-1be3-40cf-b090-8317f536a6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:41.496574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6664674-1be3-40cf-b090-8317f536a6a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:41.499657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-405bc4dd-5b12-42fa-9158-d9993495cb17 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:41.501015 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-405bc4dd-5b12-42fa-9158-d9993495cb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:41.579215 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6664674-1be3-40cf-b090-8317f536a6a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:41.580730 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6664674-1be3-40cf-b090-8317f536a6a8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:41.591390 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 452/901] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:41.621994 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:41.699283 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 450/902] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:41 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 07:12:41.704429 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bc4dd-5b12-42fa-9158-d9993495cb17 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:41.729575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6168b71-06d1-436e-a272-6f97c9c2a2f7 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:41.729864 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6168b71-06d1-436e-a272-6f97c9c2a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:41.730170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6168b71-06d1-436e-a272-6f97c9c2a2f7 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:41.731752 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 451/903] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:12:41.737355 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79caa856-cecf-4513-987d-4d6338a0b4b2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:41.737720 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79caa856-cecf-4513-987d-4d6338a0b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:41.737901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79caa856-cecf-4513-987d-4d6338a0b4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:41.756440 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-79caa856-cecf-4513-987d-4d6338a0b4b2 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:41.757607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-79caa856-cecf-4513-987d-4d6338a0b4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:41.812025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bc4dd-5b12-42fa-9158-d9993495cb17 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:41.833813 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:41.850177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 452/904] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:41.855441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424291a-627e-4155-8da3-36b9f5886199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:41.857634 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424291a-627e-4155-8da3-36b9f5886199 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:41.857634 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424291a-627e-4155-8da3-36b9f5886199 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:41.857634 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424291a-627e-4155-8da3-36b9f5886199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:41.869169 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424291a-627e-4155-8da3-36b9f5886199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:41.870325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79caa856-cecf-4513-987d-4d6338a0b4b2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:41.871103 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424291a-627e-4155-8da3-36b9f5886199 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d424291a-627e-4155-8da3-36b9f5886199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:41.892124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:41.893356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:41.894507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:41.894507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:41.894507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:41.901425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 453/905] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:41.903612 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424291a-627e-4155-8da3-36b9f5886199 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:41.950896 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:42.004899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79caa856-cecf-4513-987d-4d6338a0b4b2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:42.042422 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424291a-627e-4155-8da3-36b9f5886199 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:42.054205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a6ff5-512e-41bc-b5ad-6d4dbff1c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:42.055261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a6ff5-512e-41bc-b5ad-6d4dbff1c52b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:42.055549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a6ff5-512e-41bc-b5ad-6d4dbff1c52b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:42.055977 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a6ff5-512e-41bc-b5ad-6d4dbff1c52b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:42.056689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a6ff5-512e-41bc-b5ad-6d4dbff1c52b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:42.058846 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a6ff5-512e-41bc-b5ad-6d4dbff1c52b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-531a6ff5-512e-41bc-b5ad-6d4dbff1c52b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:42.070888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:42.072121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 07:12:42.073175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:42.074373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 453/906] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:12:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:42.078636 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a6ff5-512e-41bc-b5ad-6d4dbff1c52b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:42.088099 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458eebd-7df1-47cf-9595-dd94fb3fab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:42.088698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458eebd-7df1-47cf-9595-dd94fb3fab6a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:42.089268 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458eebd-7df1-47cf-9595-dd94fb3fab6a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:42.089541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458eebd-7df1-47cf-9595-dd94fb3fab6a None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:42.090213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458eebd-7df1-47cf-9595-dd94fb3fab6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:42.090512 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458eebd-7df1-47cf-9595-dd94fb3fab6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:42.091877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458eebd-7df1-47cf-9595-dd94fb3fab6a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:42.108455 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 454/907] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:42.113667 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458eebd-7df1-47cf-9595-dd94fb3fab6a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:42.143777 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:42.197436 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a6ff5-512e-41bc-b5ad-6d4dbff1c52b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:42.223225 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:42.223545 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458eebd-7df1-47cf-9595-dd94fb3fab6a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:42.237187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00aef-1955-4dba-bd9b-6dd6538ea237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:42.237796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00aef-1955-4dba-bd9b-6dd6538ea237 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:42.238072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00aef-1955-4dba-bd9b-6dd6538ea237 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:42.238372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b00aef-1955-4dba-bd9b-6dd6538ea237 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:42.238994 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00aef-1955-4dba-bd9b-6dd6538ea237 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:42.239289 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00aef-1955-4dba-bd9b-6dd6538ea237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:42.240743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b00aef-1955-4dba-bd9b-6dd6538ea237 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:42.245321 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 454/908] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:12:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:42.246076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00aef-1955-4dba-bd9b-6dd6538ea237 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:42.265893 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af9615-4696-43d3-96ad-6b14a7654517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:42.266552 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af9615-4696-43d3-96ad-6b14a7654517 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:42.266831 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af9615-4696-43d3-96ad-6b14a7654517 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:42.267101 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af9615-4696-43d3-96ad-6b14a7654517 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:42.273783 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af9615-4696-43d3-96ad-6b14a7654517 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:42.275247 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af9615-4696-43d3-96ad-6b14a7654517 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-01af9615-4696-43d3-96ad-6b14a7654517 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:42.287335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:42.288272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:42.289196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:42.289196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:42.289196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:42.289196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:42.289196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:42.289196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:42.289196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:42.289196 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:42.293352 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 455/909] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:42.294052 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af9615-4696-43d3-96ad-6b14a7654517 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:42.353821 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b00aef-1955-4dba-bd9b-6dd6538ea237 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:42.381835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:42.401172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27d1a-ae41-4bbc-be64-faf7449ec290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:42.401172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27d1a-ae41-4bbc-be64-faf7449ec290 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:42.401172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27d1a-ae41-4bbc-be64-faf7449ec290 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:42.401172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f27d1a-ae41-4bbc-be64-faf7449ec290 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:42.401543 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f27d1a-ae41-4bbc-be64-faf7449ec290 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:42.401543 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f27d1a-ae41-4bbc-be64-faf7449ec290 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:42.401679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af9615-4696-43d3-96ad-6b14a7654517 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-39f27d1a-ae41-4bbc-be64-faf7449ec290 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:42.406920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:42.407839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:42.408792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 455/910] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 23 07:12:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:42.409558 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27d1a-ae41-4bbc-be64-faf7449ec290 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:42.440609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c222cb-85ad-4300-8309-e6e658090f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:42.441549 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c222cb-85ad-4300-8309-e6e658090f18 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:42.442003 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c222cb-85ad-4300-8309-e6e658090f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:42.442474 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c222cb-85ad-4300-8309-e6e658090f18 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:42.443266 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c222cb-85ad-4300-8309-e6e658090f18 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:42.443743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c222cb-85ad-4300-8309-e6e658090f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:42.445320 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c222cb-85ad-4300-8309-e6e658090f18 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:42.451136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 456/911] 10.222.0.16 () {56 vars in 1114 bytes} [Tue Aug 23 07:12:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:42.452984 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c222cb-85ad-4300-8309-e6e658090f18 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:42.472135 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:42.523027 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f27d1a-ae41-4bbc-be64-faf7449ec290 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:42.560242 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c222cb-85ad-4300-8309-e6e658090f18 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:42.560788 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e457a7-6e55-4763-bec3-e23d2c614309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:42.561411 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e457a7-6e55-4763-bec3-e23d2c614309 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:42.561910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e457a7-6e55-4763-bec3-e23d2c614309 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:42.562237 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e457a7-6e55-4763-bec3-e23d2c614309 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:42.562931 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e457a7-6e55-4763-bec3-e23d2c614309 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:42.563238 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e457a7-6e55-4763-bec3-e23d2c614309 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:42.564659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e457a7-6e55-4763-bec3-e23d2c614309 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:42.577859 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 456/912] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:42.578716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e457a7-6e55-4763-bec3-e23d2c614309 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:42.606708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821bd19-4e5e-4999-a4c1-faf2b409c375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:42.607315 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bd19-4e5e-4999-a4c1-faf2b409c375 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:42.607597 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bd19-4e5e-4999-a4c1-faf2b409c375 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:42.607878 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821bd19-4e5e-4999-a4c1-faf2b409c375 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:42.609234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821bd19-4e5e-4999-a4c1-faf2b409c375 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:42.609544 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821bd19-4e5e-4999-a4c1-faf2b409c375 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:42.610939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821bd19-4e5e-4999-a4c1-faf2b409c375 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:42.615856 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 457/913] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 07:12:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:42.619687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821bd19-4e5e-4999-a4c1-faf2b409c375 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:42.639908 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:42.693884 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e457a7-6e55-4763-bec3-e23d2c614309 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:42.707966 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:42.728952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74511c-7f67-4dd6-8ecf-0d59c5595d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:42.729553 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74511c-7f67-4dd6-8ecf-0d59c5595d9c None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:42.729835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74511c-7f67-4dd6-8ecf-0d59c5595d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:42.730164 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74511c-7f67-4dd6-8ecf-0d59c5595d9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:42.730822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74511c-7f67-4dd6-8ecf-0d59c5595d9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:42.732182 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74511c-7f67-4dd6-8ecf-0d59c5595d9c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:42.733595 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821bd19-4e5e-4999-a4c1-faf2b409c375 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:42.769026 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389fd6d-2ec1-476d-9e73-fea740d34889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:42.769614 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389fd6d-2ec1-476d-9e73-fea740d34889 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:42.769902 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389fd6d-2ec1-476d-9e73-fea740d34889 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:42.770242 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389fd6d-2ec1-476d-9e73-fea740d34889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:42.770982 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389fd6d-2ec1-476d-9e73-fea740d34889 None admin] RBAC: Adding query filter params (role.id=07dc752249564549bf2144d8dc2d4ca1, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=29d8f357765e4b46887c9cf7242de24f) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:42.771272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389fd6d-2ec1-476d-9e73-fea740d34889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:42.772682 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389fd6d-2ec1-476d-9e73-fea740d34889 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:42.777904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 458/914] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:42 2022] GET /identity/v3/role_assignments?user.id=29d8f357765e4b46887c9cf7242de24f&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=07dc752249564549bf2144d8dc2d4ca1 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:42.778688 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389fd6d-2ec1-476d-9e73-fea740d34889 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:42.822369 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 457/915] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 07:12:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:42.883696 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:42.912019 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389fd6d-2ec1-476d-9e73-fea740d34889 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:42.960883 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafcef6-1e23-47f6-9b7f-0b40ecf79c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:42.961415 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafcef6-1e23-47f6-9b7f-0b40ecf79c11 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:42.961692 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafcef6-1e23-47f6-9b7f-0b40ecf79c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:42.961961 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feafcef6-1e23-47f6-9b7f-0b40ecf79c11 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:42.962624 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafcef6-1e23-47f6-9b7f-0b40ecf79c11 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:42.962930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafcef6-1e23-47f6-9b7f-0b40ecf79c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:42.964549 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feafcef6-1e23-47f6-9b7f-0b40ecf79c11 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:42.971113 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 459/916] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 07:12:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:42.977350 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74511c-7f67-4dd6-8ecf-0d59c5595d9c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:43.085048 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74511c-7f67-4dd6-8ecf-0d59c5595d9c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:43.121018 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549adf3c-79ae-421d-9cbc-4d900d3dbe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:43.121689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549adf3c-79ae-421d-9cbc-4d900d3dbe92 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:43.121971 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549adf3c-79ae-421d-9cbc-4d900d3dbe92 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:43.122271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549adf3c-79ae-421d-9cbc-4d900d3dbe92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:43.123139 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549adf3c-79ae-421d-9cbc-4d900d3dbe92 None admin] RBAC: Adding query filter params (interface=public, service_id=3ff2078ba2de482b9f9afa873fcdf757, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:43.123448 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549adf3c-79ae-421d-9cbc-4d900d3dbe92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:43.125470 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549adf3c-79ae-421d-9cbc-4d900d3dbe92 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:43.133844 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 458/917] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 07:12:42 2022] GET /identity/v3/endpoints?service_id=3ff2078ba2de482b9f9afa873fcdf757&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:43.139710 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafcef6-1e23-47f6-9b7f-0b40ecf79c11 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:43.250446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feafcef6-1e23-47f6-9b7f-0b40ecf79c11 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:43.288254 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e66a4a-1708-47f4-9a48-e7ec43d42833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:43.289208 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e66a4a-1708-47f4-9a48-e7ec43d42833 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:43.289712 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e66a4a-1708-47f4-9a48-e7ec43d42833 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:43.290213 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e66a4a-1708-47f4-9a48-e7ec43d42833 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:43.291034 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e66a4a-1708-47f4-9a48-e7ec43d42833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:43.292634 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e66a4a-1708-47f4-9a48-e7ec43d42833 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:43.299505 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 460/918] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 07:12:43 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 07:12:43.501656 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced1f73-dc14-4b63-b90e-f9898b443635 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:43.501983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced1f73-dc14-4b63-b90e-f9898b443635 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:43.502193 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced1f73-dc14-4b63-b90e-f9898b443635 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:43.503730 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 459/919] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:43.508983 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a587-a808-4f2f-ae8c-7369224586b3 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:43.509273 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a587-a808-4f2f-ae8c-7369224586b3 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:43.509550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a587-a808-4f2f-ae8c-7369224586b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:43.515952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:43.529053 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6266a587-a808-4f2f-ae8c-7369224586b3 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:43.536581 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6266a587-a808-4f2f-ae8c-7369224586b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:43.602944 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 461/920] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:43.868188 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced1f73-dc14-4b63-b90e-f9898b443635 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:43.900710 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:43.980865 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced1f73-dc14-4b63-b90e-f9898b443635 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:44.017882 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbe14a-2c24-4dbf-98b4-88214d332e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:44.018542 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbe14a-2c24-4dbf-98b4-88214d332e44 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:44.018825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbe14a-2c24-4dbf-98b4-88214d332e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:44.019097 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfbe14a-2c24-4dbf-98b4-88214d332e44 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:44.019674 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbe14a-2c24-4dbf-98b4-88214d332e44 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:44.021041 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfbe14a-2c24-4dbf-98b4-88214d332e44 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-4bfbe14a-2c24-4dbf-98b4-88214d332e44 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:44.030277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:44.031371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:44.032782 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 460/921] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 07:12:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:44.037298 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266a587-a808-4f2f-ae8c-7369224586b3 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:44.143917 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266a587-a808-4f2f-ae8c-7369224586b3 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:44.175617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:44.181091 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85928e-9885-4a8c-8d11-c55cf3524da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:44.181698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85928e-9885-4a8c-8d11-c55cf3524da7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:44.181979 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85928e-9885-4a8c-8d11-c55cf3524da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:44.182274 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85928e-9885-4a8c-8d11-c55cf3524da7 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:44.182900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85928e-9885-4a8c-8d11-c55cf3524da7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:44.183198 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85928e-9885-4a8c-8d11-c55cf3524da7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:44.184679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c85928e-9885-4a8c-8d11-c55cf3524da7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:44.189755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 462/922] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 07:12:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:44.195473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbe14a-2c24-4dbf-98b4-88214d332e44 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:44.300335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:44.306656 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfbe14a-2c24-4dbf-98b4-88214d332e44 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:44.344010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbd3b3-54c4-4397-9810-7b331133abf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:44.344624 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd3b3-54c4-4397-9810-7b331133abf4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:44.344906 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd3b3-54c4-4397-9810-7b331133abf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:44.345177 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affbd3b3-54c4-4397-9810-7b331133abf4 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:44.345809 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbd3b3-54c4-4397-9810-7b331133abf4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:44.346125 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbd3b3-54c4-4397-9810-7b331133abf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:44.347500 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affbd3b3-54c4-4397-9810-7b331133abf4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:44.352891 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 461/923] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 07:12:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:44.358770 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85928e-9885-4a8c-8d11-c55cf3524da7 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:44.470707 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85928e-9885-4a8c-8d11-c55cf3524da7 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:44.507258 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ff9ca-14c8-4676-9968-d362ebb4f278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:44.507872 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ff9ca-14c8-4676-9968-d362ebb4f278 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:44.508154 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ff9ca-14c8-4676-9968-d362ebb4f278 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:44.508424 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ff9ca-14c8-4676-9968-d362ebb4f278 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:44.509137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ff9ca-14c8-4676-9968-d362ebb4f278 None admin] RBAC: Adding query filter params (interface=public, service_id=10cccb5f2e8c455bbcbad0c778a06344, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:44.509444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ff9ca-14c8-4676-9968-d362ebb4f278 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:44.510845 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ff9ca-14c8-4676-9968-d362ebb4f278 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:44.517840 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 463/924] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 07:12:44 2022] GET /identity/v3/endpoints?service_id=10cccb5f2e8c455bbcbad0c778a06344&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:44.523317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbd3b3-54c4-4397-9810-7b331133abf4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:44.632972 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affbd3b3-54c4-4397-9810-7b331133abf4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:44.668454 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a312a-25d1-49bb-8e1a-3d7ee445c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:44.669069 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a312a-25d1-49bb-8e1a-3d7ee445c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:44.669350 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a312a-25d1-49bb-8e1a-3d7ee445c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:44.669623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a312a-25d1-49bb-8e1a-3d7ee445c2e6 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:44.670256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a312a-25d1-49bb-8e1a-3d7ee445c2e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:44.671822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a312a-25d1-49bb-8e1a-3d7ee445c2e6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:44.678328 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 462/925] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 07:12:44 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 07:12:44.756510 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854d1a9-1453-4406-b84f-f04b9f438a27 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:44.757006 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854d1a9-1453-4406-b84f-f04b9f438a27 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:44.757006 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854d1a9-1453-4406-b84f-f04b9f438a27 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:44.758661 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 464/926] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:44.765006 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a57e31-a367-4752-b69f-f2b05f1e99cc None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:44.765307 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a57e31-a367-4752-b69f-f2b05f1e99cc None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:44.765585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a57e31-a367-4752-b69f-f2b05f1e99cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:44.785358 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-38a57e31-a367-4752-b69f-f2b05f1e99cc None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:44.786598 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-38a57e31-a367-4752-b69f-f2b05f1e99cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:44.807732 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:44.862933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 463/927] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:44.916295 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646fa47-ab2f-415d-9253-1c033712cad4 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:44.916569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646fa47-ab2f-415d-9253-1c033712cad4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:44.916844 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646fa47-ab2f-415d-9253-1c033712cad4 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:44.918478 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 465/928] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:44.923904 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccd1a-db32-48cc-9cbe-ed40d91d3c4a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:44.924199 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccd1a-db32-48cc-9cbe-ed40d91d3c4a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:44.924472 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccd1a-db32-48cc-9cbe-ed40d91d3c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:44.944090 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-c08ccd1a-db32-48cc-9cbe-ed40d91d3c4a None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:44.945282 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-c08ccd1a-db32-48cc-9cbe-ed40d91d3c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:45.024849 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 464/929] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:45.138464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646fa47-ab2f-415d-9253-1c033712cad4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:45.205632 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:45.250082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646fa47-ab2f-415d-9253-1c033712cad4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:45.284871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7467770-d8b4-4d82-98ab-df871b1a0c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:45.285419 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7467770-d8b4-4d82-98ab-df871b1a0c29 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:45.285705 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7467770-d8b4-4d82-98ab-df871b1a0c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:45.285974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7467770-d8b4-4d82-98ab-df871b1a0c29 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:45.297373 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7467770-d8b4-4d82-98ab-df871b1a0c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:45.300366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccd1a-db32-48cc-9cbe-ed40d91d3c4a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b7467770-d8b4-4d82-98ab-df871b1a0c29 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:45.302904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:45.303811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:45.304656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 466/930] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 07:12:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:45.310021 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7467770-d8b4-4d82-98ab-df871b1a0c29 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:45.394221 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:45.410952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccd1a-db32-48cc-9cbe-ed40d91d3c4a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:45.417459 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7467770-d8b4-4d82-98ab-df871b1a0c29 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:45.439319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:45.447958 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eaca1-9e2a-4850-a0e9-c8052849e115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:45.448464 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eaca1-9e2a-4850-a0e9-c8052849e115 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:45.449447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eaca1-9e2a-4850-a0e9-c8052849e115 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:45.449447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eaca1-9e2a-4850-a0e9-c8052849e115 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:45.449625 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eaca1-9e2a-4850-a0e9-c8052849e115 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:45.451045 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eaca1-9e2a-4850-a0e9-c8052849e115 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:45.453705 dv-cinder-854070-3-smb devstack@keystone.service[81573]: WARNING keystone.server.flask.common [None req-a93eaca1-9e2a-4850-a0e9-c8052849e115 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 07:12:45.454129 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212dc66-46b6-4aea-9e3e-8e54fc273043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:45.454833 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212dc66-46b6-4aea-9e3e-8e54fc273043 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:45.455259 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212dc66-46b6-4aea-9e3e-8e54fc273043 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:45.455540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212dc66-46b6-4aea-9e3e-8e54fc273043 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:45.456201 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212dc66-46b6-4aea-9e3e-8e54fc273043 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:45.456505 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212dc66-46b6-4aea-9e3e-8e54fc273043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:45.457998 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1212dc66-46b6-4aea-9e3e-8e54fc273043 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:45.467919 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 467/931] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 07:12:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:45.469179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f707e13-d16f-43df-8031-dfc24325ac82 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:45.469465 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f707e13-d16f-43df-8031-dfc24325ac82 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:45.469739 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f707e13-d16f-43df-8031-dfc24325ac82 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:45.475112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 468/932] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:45.475112 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f707e13-d16f-43df-8031-dfc24325ac82 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:45.498576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.sql.core [None req-a93eaca1-9e2a-4850-a0e9-c8052849e115 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 07:12:45.498576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 07:12:45.498576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [parameters: {'id': 'c153fd8fcd4f48009348805f751647a6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 07:12:45.498576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81573) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a93eaca1-9e2a-4850-a0e9-c8052849e115 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c153fd8fcd4f48009348805f751647a6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c153fd8fcd4f48009348805f751647a6. Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:12:45.506862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 07:12:45.507633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application yield resource Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise self.value Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application session.commit() Aug 23 07:12:45.508607 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.flush() Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application compat.raise_( Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 07:12:45.509493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 07:12:45.511152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:12:45.512769 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [parameters: {'id': 'c153fd8fcd4f48009348805f751647a6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:45.515968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:45.518770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c153fd8fcd4f48009348805f751647a6. Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 465/933] 10.222.0.16 () {60 vars in 1140 bytes} [Tue Aug 23 07:12:45 2022] POST /identity/v3/projects => generated 262 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bc9e-2c78-4748-883d-d4df6c3b33d8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:45.521889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bc9e-2c78-4748-883d-d4df6c3b33d8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:45.524544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83bc9e-2c78-4748-883d-d4df6c3b33d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:45.530268 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-6b83bc9e-2c78-4748-883d-d4df6c3b33d8 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:45.531799 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-6b83bc9e-2c78-4748-883d-d4df6c3b33d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:45.583529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f707e13-d16f-43df-8031-dfc24325ac82 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:45.610401 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 466/934] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:45.611379 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83bc9e-2c78-4748-883d-d4df6c3b33d8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:45.633984 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d031b0-a77b-4c52-b38e-0592e1b9c108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:45.635024 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d031b0-a77b-4c52-b38e-0592e1b9c108 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:45.635463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d031b0-a77b-4c52-b38e-0592e1b9c108 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:45.635924 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d031b0-a77b-4c52-b38e-0592e1b9c108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:45.649389 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d031b0-a77b-4c52-b38e-0592e1b9c108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:45.652293 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d031b0-a77b-4c52-b38e-0592e1b9c108 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-53d031b0-a77b-4c52-b38e-0592e1b9c108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:45.675781 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:45.676952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:45.678039 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:45.678039 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:45.678039 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:45.680194 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 469/935] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:45.685387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d031b0-a77b-4c52-b38e-0592e1b9c108 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:45.705780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:45.749246 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83bc9e-2c78-4748-883d-d4df6c3b33d8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:45.758483 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:45.789547 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d031b0-a77b-4c52-b38e-0592e1b9c108 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:45.796067 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6833b-e17d-4ef1-9aec-0f2961514e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:45.796743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6833b-e17d-4ef1-9aec-0f2961514e65 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:45.797029 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6833b-e17d-4ef1-9aec-0f2961514e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:45.797305 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6833b-e17d-4ef1-9aec-0f2961514e65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:45.806531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6833b-e17d-4ef1-9aec-0f2961514e65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:45.809526 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6833b-e17d-4ef1-9aec-0f2961514e65 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-42b6833b-e17d-4ef1-9aec-0f2961514e65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:45.828658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:45.829770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:45.830911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:45.830911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:45.830911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:45.830911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:45.830911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:45.830911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:45.830911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:45.830911 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:45.833085 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd41e4-7106-4d6f-9c0c-0623baad12e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:45.833261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 467/936] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:45.834168 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd41e4-7106-4d6f-9c0c-0623baad12e8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:45.834437 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd41e4-7106-4d6f-9c0c-0623baad12e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:45.834775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefd41e4-7106-4d6f-9c0c-0623baad12e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:45.835565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd41e4-7106-4d6f-9c0c-0623baad12e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:45.835950 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd41e4-7106-4d6f-9c0c-0623baad12e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:45.837430 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefd41e4-7106-4d6f-9c0c-0623baad12e8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:45.839224 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6833b-e17d-4ef1-9aec-0f2961514e65 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:45.858621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 470/937] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:45.859868 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd41e4-7106-4d6f-9c0c-0623baad12e8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:45.957079 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:45.964273 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefd41e4-7106-4d6f-9c0c-0623baad12e8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:45.965119 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6833b-e17d-4ef1-9aec-0f2961514e65 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:45.993757 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:45.999110 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb074f-ff73-431b-b3d8-825fb4f27664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:45.999729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb074f-ff73-431b-b3d8-825fb4f27664 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.000043 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb074f-ff73-431b-b3d8-825fb4f27664 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.000271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e15692-54cd-4831-8c56-72350b6588fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:46.000416 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb074f-ff73-431b-b3d8-825fb4f27664 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.001051 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15692-54cd-4831-8c56-72350b6588fc None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.001432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15692-54cd-4831-8c56-72350b6588fc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.001803 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e15692-54cd-4831-8c56-72350b6588fc None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.002619 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e15692-54cd-4831-8c56-72350b6588fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:46.003026 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e15692-54cd-4831-8c56-72350b6588fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:46.004558 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e15692-54cd-4831-8c56-72350b6588fc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:46.008378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb074f-ff73-431b-b3d8-825fb4f27664 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:46.009799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb074f-ff73-431b-b3d8-825fb4f27664 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1cbb074f-ff73-431b-b3d8-825fb4f27664 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:46.022058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:46.028001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 471/938] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 07:12:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:46.029282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb074f-ff73-431b-b3d8-825fb4f27664 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:46.030977 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 468/939] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:46.030977 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e15692-54cd-4831-8c56-72350b6588fc None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:46.163321 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb074f-ff73-431b-b3d8-825fb4f27664 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:46.172392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e15692-54cd-4831-8c56-72350b6588fc None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:46.209447 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96a231-70ab-4afa-8552-995469cad7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:46.210073 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96a231-70ab-4afa-8552-995469cad7d6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.210518 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96a231-70ab-4afa-8552-995469cad7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.210789 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96a231-70ab-4afa-8552-995469cad7d6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.211381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96a231-70ab-4afa-8552-995469cad7d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:46.212745 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96a231-70ab-4afa-8552-995469cad7d6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:46.218861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f509c17-bebc-4d85-aca6-aeb425d35e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:46.219639 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f509c17-bebc-4d85-aca6-aeb425d35e58 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.220066 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f509c17-bebc-4d85-aca6-aeb425d35e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.220517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f509c17-bebc-4d85-aca6-aeb425d35e58 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.221790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f509c17-bebc-4d85-aca6-aeb425d35e58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:46.222279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f509c17-bebc-4d85-aca6-aeb425d35e58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ac96a231-70ab-4afa-8552-995469cad7d6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:46.223062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:46.223997 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 07:12:46.224980 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:46.227266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f509c17-bebc-4d85-aca6-aeb425d35e58 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:46.229098 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 472/940] 10.222.0.16 () {56 vars in 1132 bytes} [Tue Aug 23 07:12:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:46.230369 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96a231-70ab-4afa-8552-995469cad7d6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:46.247920 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 469/941] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 07:12:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:46.253055 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:46.254054 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f509c17-bebc-4d85-aca6-aeb425d35e58 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:46.315403 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:46.369061 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96a231-70ab-4afa-8552-995469cad7d6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:46.374378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f509c17-bebc-4d85-aca6-aeb425d35e58 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:46.410843 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10009577-0cb1-4017-94f4-638611144707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:46.411785 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009577-0cb1-4017-94f4-638611144707 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.412460 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009577-0cb1-4017-94f4-638611144707 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.412870 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009577-0cb1-4017-94f4-638611144707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.416600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703f69-89b9-40e1-b466-b021af94a465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:46.417244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703f69-89b9-40e1-b466-b021af94a465 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.417616 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703f69-89b9-40e1-b466-b021af94a465 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.417979 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b703f69-89b9-40e1-b466-b021af94a465 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.418722 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b703f69-89b9-40e1-b466-b021af94a465 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:46.419116 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b703f69-89b9-40e1-b466-b021af94a465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:46.420743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b703f69-89b9-40e1-b466-b021af94a465 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:46.425361 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10009577-0cb1-4017-94f4-638611144707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:46.427057 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10009577-0cb1-4017-94f4-638611144707 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:46.427796 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 473/942] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 07:12:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:46.433018 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703f69-89b9-40e1-b466-b021af94a465 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-10009577-0cb1-4017-94f4-638611144707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:46.444421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:46.445593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:46.446702 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:46.446702 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:46.446702 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:46.454065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 470/943] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:46.455223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10009577-0cb1-4017-94f4-638611144707 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:46.537514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:46.558645 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b703f69-89b9-40e1-b466-b021af94a465 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:46.569738 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:46.574428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10009577-0cb1-4017-94f4-638611144707 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:46.609209 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a39cd-21bb-4ade-8a97-6e2654626801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:46.610138 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a39cd-21bb-4ade-8a97-6e2654626801 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.610426 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a39cd-21bb-4ade-8a97-6e2654626801 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.610699 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a39cd-21bb-4ade-8a97-6e2654626801 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.611341 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a39cd-21bb-4ade-8a97-6e2654626801 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:46.611643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a39cd-21bb-4ade-8a97-6e2654626801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:46.613497 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a39cd-21bb-4ade-8a97-6e2654626801 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:46.620172 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 474/944] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 07:12:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:46.625737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a39cd-21bb-4ade-8a97-6e2654626801 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:46.632195 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad296d-a91b-4a0c-ae14-ef48e310b4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:46.632811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad296d-a91b-4a0c-ae14-ef48e310b4fd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.633090 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad296d-a91b-4a0c-ae14-ef48e310b4fd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.633363 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ad296d-a91b-4a0c-ae14-ef48e310b4fd None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.634011 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad296d-a91b-4a0c-ae14-ef48e310b4fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:46.634342 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad296d-a91b-4a0c-ae14-ef48e310b4fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:46.635719 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ad296d-a91b-4a0c-ae14-ef48e310b4fd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:46.648370 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 471/945] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:46.653686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad296d-a91b-4a0c-ae14-ef48e310b4fd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:46.745314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a39cd-21bb-4ade-8a97-6e2654626801 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:46.762998 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ad296d-a91b-4a0c-ae14-ef48e310b4fd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:46.786697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac546e-79bb-404e-b0ed-f61fd231c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:46.787300 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac546e-79bb-404e-b0ed-f61fd231c722 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.787576 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac546e-79bb-404e-b0ed-f61fd231c722 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.787877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac546e-79bb-404e-b0ed-f61fd231c722 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.788917 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac546e-79bb-404e-b0ed-f61fd231c722 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:46.789921 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfac546e-79bb-404e-b0ed-f61fd231c722 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:46.803835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5922d-00e9-4464-8920-948376dc342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:46.804547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5922d-00e9-4464-8920-948376dc342f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.804895 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5922d-00e9-4464-8920-948376dc342f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.805251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5922d-00e9-4464-8920-948376dc342f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.812576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5922d-00e9-4464-8920-948376dc342f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:46.814534 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5922d-00e9-4464-8920-948376dc342f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-77d5922d-00e9-4464-8920-948376dc342f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:46.825080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:46.831091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:46.832065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:46.832065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:46.832065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:46.832065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:46.832065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:46.832065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:46.832065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:46.832065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:46.832065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 472/946] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:46.832065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d934-6d62-416d-9f54-f09bda062173 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.832065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d934-6d62-416d-9f54-f09bda062173 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.832688 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5d934-6d62-416d-9f54-f09bda062173 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.832688 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 473/947] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:46.832688 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5d934-6d62-416d-9f54-f09bda062173 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:46.854952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:46.878369 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 475/948] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 07:12:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:46.878369 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76914f-68d5-4209-b990-9478b4a6bb23 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.878369 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76914f-68d5-4209-b990-9478b4a6bb23 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.878369 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76914f-68d5-4209-b990-9478b4a6bb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.882668 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:46.900080 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8f76914f-68d5-4209-b990-9478b4a6bb23 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:46.902061 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8f76914f-68d5-4209-b990-9478b4a6bb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:46.956284 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5d934-6d62-416d-9f54-f09bda062173 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:46.995887 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b648eda-569b-4342-98d9-68d2ff281f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:46.996456 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b648eda-569b-4342-98d9-68d2ff281f6d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:46.996735 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b648eda-569b-4342-98d9-68d2ff281f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:46.997006 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b648eda-569b-4342-98d9-68d2ff281f6d None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:46.997711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b648eda-569b-4342-98d9-68d2ff281f6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:46.998015 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b648eda-569b-4342-98d9-68d2ff281f6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:46.999547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b648eda-569b-4342-98d9-68d2ff281f6d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:47.010274 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 476/949] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:47.018475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 474/950] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:47.024289 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76914f-68d5-4209-b990-9478b4a6bb23 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:47.130340 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76914f-68d5-4209-b990-9478b4a6bb23 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:47.162476 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:47.168143 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dd8dc-e4a4-455c-9d7c-5cdd43445fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:47.170421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd8dc-e4a4-455c-9d7c-5cdd43445fe4 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:47.170421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd8dc-e4a4-455c-9d7c-5cdd43445fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:47.170421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd8dc-e4a4-455c-9d7c-5cdd43445fe4 None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/29d8f357765e4b46887c9cf7242de24f/roles/07dc752249564549bf2144d8dc2d4ca1` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:47.172492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2dd8dc-e4a4-455c-9d7c-5cdd43445fe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=29d8f357765e4b46887c9cf7242de24f, role_id=07dc752249564549bf2144d8dc2d4ca1)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:47.174187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2dd8dc-e4a4-455c-9d7c-5cdd43445fe4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:47.260243 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 477/951] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:12:47 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/29d8f357765e4b46887c9cf7242de24f/roles/07dc752249564549bf2144d8dc2d4ca1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:12:47.296097 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b648eda-569b-4342-98d9-68d2ff281f6d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:47.387536 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:47.415596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b648eda-569b-4342-98d9-68d2ff281f6d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:47.452943 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b15178-d685-4710-89ca-d1005720c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:47.453577 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15178-d685-4710-89ca-d1005720c280 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:47.453855 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15178-d685-4710-89ca-d1005720c280 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:47.454149 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b15178-d685-4710-89ca-d1005720c280 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:47.454734 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b15178-d685-4710-89ca-d1005720c280 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:47.456095 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b15178-d685-4710-89ca-d1005720c280 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-74b15178-d685-4710-89ca-d1005720c280 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:47.465306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:47.466614 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:47.468062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 475/952] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 07:12:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:47.475514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dd8dc-e4a4-455c-9d7c-5cdd43445fe4 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:47.581072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dd8dc-e4a4-455c-9d7c-5cdd43445fe4 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:47.617336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b268e08-ec41-42c9-94a3-ee55090e54c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:47.618134 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b268e08-ec41-42c9-94a3-ee55090e54c2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:47.618520 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b268e08-ec41-42c9-94a3-ee55090e54c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:47.618895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b268e08-ec41-42c9-94a3-ee55090e54c2 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:47.619633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b268e08-ec41-42c9-94a3-ee55090e54c2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:47.620117 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b268e08-ec41-42c9-94a3-ee55090e54c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:47.621600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b268e08-ec41-42c9-94a3-ee55090e54c2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:47.627540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 478/953] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 07:12:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:47.633294 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b15178-d685-4710-89ca-d1005720c280 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:47.744500 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b15178-d685-4710-89ca-d1005720c280 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:47.784230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28135ca1-dd5c-46ba-be43-fecec28671f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:47.784835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135ca1-dd5c-46ba-be43-fecec28671f3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:47.785110 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135ca1-dd5c-46ba-be43-fecec28671f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:47.785376 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28135ca1-dd5c-46ba-be43-fecec28671f3 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:47.785997 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28135ca1-dd5c-46ba-be43-fecec28671f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:47.786322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28135ca1-dd5c-46ba-be43-fecec28671f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:47.787683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28135ca1-dd5c-46ba-be43-fecec28671f3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:47.793033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 476/954] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 07:12:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:47.799457 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b268e08-ec41-42c9-94a3-ee55090e54c2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:47.858844 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:47.905195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b268e08-ec41-42c9-94a3-ee55090e54c2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:47.939615 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb09853-97d0-4583-b50f-f0f8a90589ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:47.940218 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb09853-97d0-4583-b50f-f0f8a90589ed None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:47.940496 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb09853-97d0-4583-b50f-f0f8a90589ed None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:47.940764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb09853-97d0-4583-b50f-f0f8a90589ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:47.941425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb09853-97d0-4583-b50f-f0f8a90589ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:47.942827 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb09853-97d0-4583-b50f-f0f8a90589ed None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:48.019236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 479/955] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 07:12:47 2022] POST /identity/v3/endpoints => generated 349 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:48.096975 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f11682-1324-4bcc-b91c-a4d51e468689 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:48.097340 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f11682-1324-4bcc-b91c-a4d51e468689 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:48.097519 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f11682-1324-4bcc-b91c-a4d51e468689 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:48.099377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 477/956] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:48.105358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b646b-e31b-4878-aaa8-1274a22bb09c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:48.105644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b646b-e31b-4878-aaa8-1274a22bb09c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:48.105912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b646b-e31b-4878-aaa8-1274a22bb09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:48.126383 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-132b646b-e31b-4878-aaa8-1274a22bb09c None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:48.127529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-132b646b-e31b-4878-aaa8-1274a22bb09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:48.215650 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 480/957] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:48.483647 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f11682-1324-4bcc-b91c-a4d51e468689 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:48.488668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:48.601686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f11682-1324-4bcc-b91c-a4d51e468689 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:48.641377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034a584-fe65-411d-baf8-50b2aa00fb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:48.641990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034a584-fe65-411d-baf8-50b2aa00fb57 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:48.642292 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034a584-fe65-411d-baf8-50b2aa00fb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:48.642561 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034a584-fe65-411d-baf8-50b2aa00fb57 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:48.643200 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034a584-fe65-411d-baf8-50b2aa00fb57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:48.644622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e034a584-fe65-411d-baf8-50b2aa00fb57 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:48.687597 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.sql.core [None req-e034a584-fe65-411d-baf8-50b2aa00fb57 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 07:12:48.687597 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 07:12:48.687597 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [parameters: {'user_id': 'f9cd96e20b354f3d853dbd6185d417ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 07:12:48.687597 dv-cinder-854070-3-smb devstack@keystone.service[81573]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81573) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e034a584-fe65-411d-baf8-50b2aa00fb57 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Aug 23 07:12:48.694317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:12:48.698360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application yield resource Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application next(self.gen) Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise self.value Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application session.commit() Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 07:12:48.700616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.session.flush() Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application compat.raise_( Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 07:12:48.703576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 07:12:48.705670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application conn.query(q) Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application result.read() Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 07:12:48.707272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f9cd96e20b354f3d853dbd6185d417ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:48.708304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 07:12:48.709297 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 07:12:48.718525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 07:12:48.718525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 07:12:48.718525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 07:12:48.718525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 07:12:48.718525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 07:12:48.718525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:48.718525 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 478/958] 10.222.0.16 () {60 vars in 1131 bytes} [Tue Aug 23 07:12:48 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:48.719032 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b646b-e31b-4878-aaa8-1274a22bb09c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:48.750692 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:48.815254 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b646b-e31b-4878-aaa8-1274a22bb09c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:48.850519 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd512f3-2ab3-4c06-bd24-2bf78aea2f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:48.851193 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd512f3-2ab3-4c06-bd24-2bf78aea2f91 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:48.851476 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd512f3-2ab3-4c06-bd24-2bf78aea2f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:48.851742 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd512f3-2ab3-4c06-bd24-2bf78aea2f91 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:48.859898 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd512f3-2ab3-4c06-bd24-2bf78aea2f91 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:48.861341 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd512f3-2ab3-4c06-bd24-2bf78aea2f91 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ffd512f3-2ab3-4c06-bd24-2bf78aea2f91 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:48.874127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:48.876329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:48.878720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:48.878720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:48.878720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:48.878720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:48.878720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:48.878720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:48.878720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:48.878720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:48.878720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 07:12:48.878720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:48.880055 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 481/959] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:12:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:48.884976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034a584-fe65-411d-baf8-50b2aa00fb57 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:48.953105 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:48.989684 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034a584-fe65-411d-baf8-50b2aa00fb57 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:49.005366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14320060-2647-40fb-b4cd-43955cbfda90 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:49.005628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14320060-2647-40fb-b4cd-43955cbfda90 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:49.005842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14320060-2647-40fb-b4cd-43955cbfda90 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:49.007475 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 482/960] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:49.012447 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf906d-02e8-446a-9d6e-ef99ee4a2f1a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:49.019517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf906d-02e8-446a-9d6e-ef99ee4a2f1a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:49.019517 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf906d-02e8-446a-9d6e-ef99ee4a2f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:49.025591 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932261f-1967-4980-8baa-5255ca5b001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:49.026261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932261f-1967-4980-8baa-5255ca5b001f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:49.026629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932261f-1967-4980-8baa-5255ca5b001f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:49.026905 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932261f-1967-4980-8baa-5255ca5b001f None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:49.027610 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932261f-1967-4980-8baa-5255ca5b001f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:49.027910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932261f-1967-4980-8baa-5255ca5b001f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:49.029622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932261f-1967-4980-8baa-5255ca5b001f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:49.033325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-fabf906d-02e8-446a-9d6e-ef99ee4a2f1a None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:49.034814 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-fabf906d-02e8-446a-9d6e-ef99ee4a2f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:49.077289 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 479/961] 10.222.0.16 () {56 vars in 1101 bytes} [Tue Aug 23 07:12:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:49.111073 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 483/962] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:12:49.284505 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a586-f7ec-48e6-9c6a-0cab091dccde None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:49.284820 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a586-f7ec-48e6-9c6a-0cab091dccde None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:49.285002 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a586-f7ec-48e6-9c6a-0cab091dccde None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:49.286502 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 480/963] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:49.291933 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df05ff2-1028-404e-816c-4c220ecba67c None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:49.292214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df05ff2-1028-404e-816c-4c220ecba67c None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:49.292482 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df05ff2-1028-404e-816c-4c220ecba67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:49.313739 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-2df05ff2-1028-404e-816c-4c220ecba67c None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:49.315045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-2df05ff2-1028-404e-816c-4c220ecba67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:49.340395 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:49.386742 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 484/964] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:49.387003 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a586-f7ec-48e6-9c6a-0cab091dccde None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:49.489711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a586-f7ec-48e6-9c6a-0cab091dccde None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:49.513096 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:49.524895 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbcd8f-f325-4f9f-b0a5-22a2940d5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:49.525530 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbcd8f-f325-4f9f-b0a5-22a2940d5d7e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:49.525809 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbcd8f-f325-4f9f-b0a5-22a2940d5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:49.526081 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbcd8f-f325-4f9f-b0a5-22a2940d5d7e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:49.526684 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbcd8f-f325-4f9f-b0a5-22a2940d5d7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:49.528045 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbcd8f-f325-4f9f-b0a5-22a2940d5d7e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-24cbcd8f-f325-4f9f-b0a5-22a2940d5d7e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:49.536899 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:49.537935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:12:49.538801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:49.542185 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 481/965] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:49.544080 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df05ff2-1028-404e-816c-4c220ecba67c None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:49.651892 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df05ff2-1028-404e-816c-4c220ecba67c None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:49.663256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbcd8f-f325-4f9f-b0a5-22a2940d5d7e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:49.689672 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b063f-468f-4b76-9405-5d0c34960828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:49.690311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b063f-468f-4b76-9405-5d0c34960828 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:49.690592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b063f-468f-4b76-9405-5d0c34960828 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:49.691042 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b063f-468f-4b76-9405-5d0c34960828 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:49.691487 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b063f-468f-4b76-9405-5d0c34960828 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:49.691789 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b063f-468f-4b76-9405-5d0c34960828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:49.693148 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b063f-468f-4b76-9405-5d0c34960828 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:49.697934 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 485/966] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:49.703417 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b063f-468f-4b76-9405-5d0c34960828 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:49.729568 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:49.772110 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbcd8f-f325-4f9f-b0a5-22a2940d5d7e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:49.807910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac64b5b-5e1d-4ff9-a847-f1de2ec61c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:49.808451 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64b5b-5e1d-4ff9-a847-f1de2ec61c89 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:49.808724 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64b5b-5e1d-4ff9-a847-f1de2ec61c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:49.808989 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64b5b-5e1d-4ff9-a847-f1de2ec61c89 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:49.812054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b063f-468f-4b76-9405-5d0c34960828 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:49.820510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac64b5b-5e1d-4ff9-a847-f1de2ec61c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-fac64b5b-5e1d-4ff9-a847-f1de2ec61c89 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:12:49.825733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:49.827564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:12:49.829205 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:49.832593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 482/967] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 07:12:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:49.833716 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac64b5b-5e1d-4ff9-a847-f1de2ec61c89 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:49.854477 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595e333-30ee-4db1-b37a-e994bd0ef0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:49.855167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595e333-30ee-4db1-b37a-e994bd0ef0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:49.855360 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595e333-30ee-4db1-b37a-e994bd0ef0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:49.855632 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595e333-30ee-4db1-b37a-e994bd0ef0c1 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:49.856267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595e333-30ee-4db1-b37a-e994bd0ef0c1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:49.856806 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595e333-30ee-4db1-b37a-e994bd0ef0c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:49.857996 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6595e333-30ee-4db1-b37a-e994bd0ef0c1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:49.864859 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 486/968] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:49.890801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:49.947501 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac64b5b-5e1d-4ff9-a847-f1de2ec61c89 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:49.984983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409b8f5-c816-42c1-99f1-b35ae63db544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:49.985616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409b8f5-c816-42c1-99f1-b35ae63db544 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:49.985898 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409b8f5-c816-42c1-99f1-b35ae63db544 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:49.986197 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409b8f5-c816-42c1-99f1-b35ae63db544 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:49.986873 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409b8f5-c816-42c1-99f1-b35ae63db544 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:49.987173 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409b8f5-c816-42c1-99f1-b35ae63db544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:49.988556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409b8f5-c816-42c1-99f1-b35ae63db544 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:49.997733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 483/969] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 07:12:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:50.003435 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595e333-30ee-4db1-b37a-e994bd0ef0c1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:50.093802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:50.109402 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595e333-30ee-4db1-b37a-e994bd0ef0c1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:50.111696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac26f4-a902-482d-8c2b-04e561350b02 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:50.111990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac26f4-a902-482d-8c2b-04e561350b02 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:50.112274 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac26f4-a902-482d-8c2b-04e561350b02 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:50.113622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 484/970] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:12:50.118696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783764-fca6-4ae1-bea8-9c28396c480e None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:50.118980 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783764-fca6-4ae1-bea8-9c28396c480e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:50.119325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783764-fca6-4ae1-bea8-9c28396c480e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:50.137744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-81783764-fca6-4ae1-bea8-9c28396c480e None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:50.139340 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-81783764-fca6-4ae1-bea8-9c28396c480e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:50.145475 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c06d11-cce0-4526-b282-1f153747834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:50.146109 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c06d11-cce0-4526-b282-1f153747834a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:50.146400 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c06d11-cce0-4526-b282-1f153747834a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:50.146668 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c06d11-cce0-4526-b282-1f153747834a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:50.157662 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c06d11-cce0-4526-b282-1f153747834a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:50.159136 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c06d11-cce0-4526-b282-1f153747834a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d1c06d11-cce0-4526-b282-1f153747834a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:50.174725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:50.175738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:50.176620 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:50.176620 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:50.176620 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:50.176620 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 487/971] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:50.181559 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c06d11-cce0-4526-b282-1f153747834a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:50.210761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 485/972] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:50.288838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c06d11-cce0-4526-b282-1f153747834a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:50.323181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4541338-a754-497f-8bc5-866cf52e0f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:50.323782 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4541338-a754-497f-8bc5-866cf52e0f65 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:50.324060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4541338-a754-497f-8bc5-866cf52e0f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:50.324330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4541338-a754-497f-8bc5-866cf52e0f65 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:50.324968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4541338-a754-497f-8bc5-866cf52e0f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:50.325267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4541338-a754-497f-8bc5-866cf52e0f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:50.327324 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4541338-a754-497f-8bc5-866cf52e0f65 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:50.334647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:50.340594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 488/973] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:50.346942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81783764-fca6-4ae1-bea8-9c28396c480e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:50.391034 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:50.448807 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81783764-fca6-4ae1-bea8-9c28396c480e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:50.478548 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4541338-a754-497f-8bc5-866cf52e0f65 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:50.484830 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8321c-253f-43d4-b582-cde7533e3c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:50.485471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8321c-253f-43d4-b582-cde7533e3c6f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:50.485750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8321c-253f-43d4-b582-cde7533e3c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:50.486021 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8321c-253f-43d4-b582-cde7533e3c6f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:50.493318 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8321c-253f-43d4-b582-cde7533e3c6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:50.494790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8321c-253f-43d4-b582-cde7533e3c6f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-b0c8321c-253f-43d4-b582-cde7533e3c6f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:12:50.506303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:50.507494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:50.508642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:50.508642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:50.508642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:12:50.508642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:12:50.508642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:12:50.508642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:12:50.508642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:12:50.508642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:12:50.508642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 07:12:50.508642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:50.512206 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 486/974] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 07:12:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:50.513231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8321c-253f-43d4-b582-cde7533e3c6f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:50.587175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4541338-a754-497f-8bc5-866cf52e0f65 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:50.619491 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:50.622427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8321c-253f-43d4-b582-cde7533e3c6f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:50.624726 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8fb4-cf1a-42f5-84a5-26748406f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:50.625432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8fb4-cf1a-42f5-84a5-26748406f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:50.625740 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8fb4-cf1a-42f5-84a5-26748406f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:50.625988 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42f8fb4-cf1a-42f5-84a5-26748406f1a6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:50.626600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f8fb4-cf1a-42f5-84a5-26748406f1a6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:50.627966 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42f8fb4-cf1a-42f5-84a5-26748406f1a6 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-b42f8fb4-cf1a-42f5-84a5-26748406f1a6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:50.636735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:50.637930 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:50.640035 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 489/975] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 07:12:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:50.644586 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8fb4-cf1a-42f5-84a5-26748406f1a6 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:50.663972 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04709c44-ba26-41ac-b447-457be5ff1a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:50.664574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709c44-ba26-41ac-b447-457be5ff1a2b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:50.664850 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709c44-ba26-41ac-b447-457be5ff1a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:50.665117 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04709c44-ba26-41ac-b447-457be5ff1a2b None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:50.665841 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04709c44-ba26-41ac-b447-457be5ff1a2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:50.666166 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04709c44-ba26-41ac-b447-457be5ff1a2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:50.667585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04709c44-ba26-41ac-b447-457be5ff1a2b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:50.685315 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 487/976] 10.222.0.16 () {56 vars in 1149 bytes} [Tue Aug 23 07:12:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:50.691608 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04709c44-ba26-41ac-b447-457be5ff1a2b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:50.708398 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:50.750320 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42f8fb4-cf1a-42f5-84a5-26748406f1a6 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:50.785973 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fbeb7-1986-478c-bef3-103893e13912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:50.786665 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fbeb7-1986-478c-bef3-103893e13912 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:50.786943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fbeb7-1986-478c-bef3-103893e13912 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:50.787214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fbeb7-1986-478c-bef3-103893e13912 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:50.787957 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fbeb7-1986-478c-bef3-103893e13912 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:50.788374 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fbeb7-1986-478c-bef3-103893e13912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:50.789735 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5fbeb7-1986-478c-bef3-103893e13912 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:50.793775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04709c44-ba26-41ac-b447-457be5ff1a2b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:50.799811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 490/977] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 07:12:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:50.800535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fbeb7-1986-478c-bef3-103893e13912 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:50.829411 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f63714-4881-4f52-90d1-d535769bee34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:50.830019 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f63714-4881-4f52-90d1-d535769bee34 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:50.830320 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f63714-4881-4f52-90d1-d535769bee34 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:50.830591 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f63714-4881-4f52-90d1-d535769bee34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:50.861667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:50.905223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f63714-4881-4f52-90d1-d535769bee34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:50.907445 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f63714-4881-4f52-90d1-d535769bee34 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:50.920541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fbeb7-1986-478c-bef3-103893e13912 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:50.956658 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:50.968109 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d54cea-76e5-42ce-a3c3-3a5b2d7f87f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:50.968709 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d54cea-76e5-42ce-a3c3-3a5b2d7f87f8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:50.968988 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d54cea-76e5-42ce-a3c3-3a5b2d7f87f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:50.969259 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d54cea-76e5-42ce-a3c3-3a5b2d7f87f8 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:50.969885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d54cea-76e5-42ce-a3c3-3a5b2d7f87f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:50.970214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d54cea-76e5-42ce-a3c3-3a5b2d7f87f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:50.971575 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d54cea-76e5-42ce-a3c3-3a5b2d7f87f8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:50.981638 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 491/978] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 07:12:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:50.983426 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d54cea-76e5-42ce-a3c3-3a5b2d7f87f8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:51.018412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 488/979] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:12:50 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 07:12:51.024099 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f63714-4881-4f52-90d1-d535769bee34 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:51.083884 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:51.094922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d54cea-76e5-42ce-a3c3-3a5b2d7f87f8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:51.128569 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f63714-4881-4f52-90d1-d535769bee34 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:51.130784 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fc81b-d90d-4865-bda6-ed0321e614d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:51.131462 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fc81b-d90d-4865-bda6-ed0321e614d3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:51.131746 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fc81b-d90d-4865-bda6-ed0321e614d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:51.132017 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fc81b-d90d-4865-bda6-ed0321e614d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:51.132720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fc81b-d90d-4865-bda6-ed0321e614d3 None admin] RBAC: Adding query filter params (interface=admin, service_id=10cccb5f2e8c455bbcbad0c778a06344, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:51.133023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fc81b-d90d-4865-bda6-ed0321e614d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:51.134405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479fc81b-d90d-4865-bda6-ed0321e614d3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:51.144387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 492/980] 10.222.0.16 () {56 vars in 1249 bytes} [Tue Aug 23 07:12:50 2022] GET /identity/v3/endpoints?service_id=10cccb5f2e8c455bbcbad0c778a06344&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:51.145361 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fc81b-d90d-4865-bda6-ed0321e614d3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:51.167325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de29c9a-6d7e-4fad-89ef-80f74b8c54c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:51.167884 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29c9a-6d7e-4fad-89ef-80f74b8c54c7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:51.168187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29c9a-6d7e-4fad-89ef-80f74b8c54c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:51.168458 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de29c9a-6d7e-4fad-89ef-80f74b8c54c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:51.179874 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de29c9a-6d7e-4fad-89ef-80f74b8c54c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:51.181306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de29c9a-6d7e-4fad-89ef-80f74b8c54c7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8de29c9a-6d7e-4fad-89ef-80f74b8c54c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:12:51.196790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:51.197760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:12:51.199118 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:12:51.199118 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:12:51.199118 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:51.199118 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 489/981] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:51.203600 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de29c9a-6d7e-4fad-89ef-80f74b8c54c7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:51.207644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:51.256062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fc81b-d90d-4865-bda6-ed0321e614d3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:51.290896 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ac08a-ad28-4c7c-a002-e9df66d582c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:51.291786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ac08a-ad28-4c7c-a002-e9df66d582c3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:51.292247 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ac08a-ad28-4c7c-a002-e9df66d582c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:51.292685 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ac08a-ad28-4c7c-a002-e9df66d582c3 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:51.293550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ac08a-ad28-4c7c-a002-e9df66d582c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:51.295911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ac08a-ad28-4c7c-a002-e9df66d582c3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:51.302947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 493/982] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 07:12:51 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 07:12:51.323341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de29c9a-6d7e-4fad-89ef-80f74b8c54c7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:51.337250 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:51.364740 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e7606-048c-470c-936c-d3a94df1fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:51.365365 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e7606-048c-470c-936c-d3a94df1fd8d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:51.365641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e7606-048c-470c-936c-d3a94df1fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:51.365909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13e7606-048c-470c-936c-d3a94df1fd8d None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:51.366597 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e7606-048c-470c-936c-d3a94df1fd8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:51.366896 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e7606-048c-470c-936c-d3a94df1fd8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:51.368292 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13e7606-048c-470c-936c-d3a94df1fd8d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:51.386699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 490/983] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:51.388965 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ac08a-ad28-4c7c-a002-e9df66d582c3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:51.498046 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ac08a-ad28-4c7c-a002-e9df66d582c3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:51.515791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:51.532532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b47081-d763-4c38-990f-eed074d0d3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:51.533387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47081-d763-4c38-990f-eed074d0d3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:51.533692 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47081-d763-4c38-990f-eed074d0d3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:51.534064 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b47081-d763-4c38-990f-eed074d0d3e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:51.540804 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b47081-d763-4c38-990f-eed074d0d3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:51.542357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b47081-d763-4c38-990f-eed074d0d3e8 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-62b47081-d763-4c38-990f-eed074d0d3e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:12:51.554434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:51.555490 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:51.556569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:12:51.556569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:12:51.556569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:12:51.556569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:12:51.556569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:12:51.556569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:12:51.556569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:12:51.556569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:51.563366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 494/984] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:51.564595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e7606-048c-470c-936c-d3a94df1fd8d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:51.673164 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13e7606-048c-470c-936c-d3a94df1fd8d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:51.708564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b58f101-befa-4790-b0c3-ca3731400fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:51.709175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58f101-befa-4790-b0c3-ca3731400fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:51.709452 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58f101-befa-4790-b0c3-ca3731400fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:51.709718 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b58f101-befa-4790-b0c3-ca3731400fd4 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:51.710790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58f101-befa-4790-b0c3-ca3731400fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:51.711208 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58f101-befa-4790-b0c3-ca3731400fd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:51.712640 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b58f101-befa-4790-b0c3-ca3731400fd4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:51.730323 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 491/985] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:12:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:51.731550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b47081-d763-4c38-990f-eed074d0d3e8 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:51.799910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7fa5-687a-436d-958b-5e672ced4a9a None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:51.800274 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7fa5-687a-436d-958b-5e672ced4a9a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:51.800694 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c7fa5-687a-436d-958b-5e672ced4a9a None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:51.802309 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 492/986] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:51.807306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408785b-788f-44f1-bf6a-093bce87740d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:51.807742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408785b-788f-44f1-bf6a-093bce87740d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:51.808183 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408785b-788f-44f1-bf6a-093bce87740d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:51.827799 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d408785b-788f-44f1-bf6a-093bce87740d None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:51.829204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d408785b-788f-44f1-bf6a-093bce87740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:51.838682 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b47081-d763-4c38-990f-eed074d0d3e8 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:51.853693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:51.875538 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515d1a7-02ee-47a5-aa91-fc9411248ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:51.876337 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515d1a7-02ee-47a5-aa91-fc9411248ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:51.876337 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515d1a7-02ee-47a5-aa91-fc9411248ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:51.876548 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515d1a7-02ee-47a5-aa91-fc9411248ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:51.877279 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515d1a7-02ee-47a5-aa91-fc9411248ea0 None admin] RBAC: Adding query filter params (role.id=07dc752249564549bf2144d8dc2d4ca1, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=29d8f357765e4b46887c9cf7242de24f) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:51.877585 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515d1a7-02ee-47a5-aa91-fc9411248ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:51.879037 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515d1a7-02ee-47a5-aa91-fc9411248ea0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:51.885090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 495/987] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:12:51 2022] GET /identity/v3/role_assignments?user.id=29d8f357765e4b46887c9cf7242de24f&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=07dc752249564549bf2144d8dc2d4ca1 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:51.901876 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 493/988] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:12:52.173932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515d1a7-02ee-47a5-aa91-fc9411248ea0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:52.219759 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:52.279079 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515d1a7-02ee-47a5-aa91-fc9411248ea0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:52.314092 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88873141-d483-4656-b8af-db3218bc3a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:52.314748 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873141-d483-4656-b8af-db3218bc3a2b None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:52.315031 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873141-d483-4656-b8af-db3218bc3a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:52.315307 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88873141-d483-4656-b8af-db3218bc3a2b None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:52.315964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88873141-d483-4656-b8af-db3218bc3a2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:52.317337 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88873141-d483-4656-b8af-db3218bc3a2b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:52.419314 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 496/989] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:12:52 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:53.234347 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35b597-46c7-4d36-8b1b-79b6cb6ebaaf None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:53.234897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35b597-46c7-4d36-8b1b-79b6cb6ebaaf None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:53.234897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35b597-46c7-4d36-8b1b-79b6cb6ebaaf None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:53.236271 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 494/990] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:53.241658 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838715-a596-4812-82ed-60551e567a4f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:53.242034 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838715-a596-4812-82ed-60551e567a4f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:53.242245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838715-a596-4812-82ed-60551e567a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:53.261699 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-69838715-a596-4812-82ed-60551e567a4f None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:53.262902 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-69838715-a596-4812-82ed-60551e567a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:53.336946 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 497/991] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:53.606976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35b597-46c7-4d36-8b1b-79b6cb6ebaaf None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:53.709989 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35b597-46c7-4d36-8b1b-79b6cb6ebaaf None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:53.744412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c499a-9bd2-479c-9b4a-d9da752f9c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:53.745040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c499a-9bd2-479c-9b4a-d9da752f9c8d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:53.745349 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c499a-9bd2-479c-9b4a-d9da752f9c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:53.745623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c499a-9bd2-479c-9b4a-d9da752f9c8d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:53.746222 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c499a-9bd2-479c-9b4a-d9da752f9c8d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:53.747585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c499a-9bd2-479c-9b4a-d9da752f9c8d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d71c499a-9bd2-479c-9b4a-d9da752f9c8d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:53.756667 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:53.757666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 07:12:53.758901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:53.762175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 495/992] 10.222.0.16 () {56 vars in 1126 bytes} [Tue Aug 23 07:12:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:53.764095 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69838715-a596-4812-82ed-60551e567a4f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:53.792198 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:53.823085 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de1212-ad04-4b97-9379-e82e39def7ce None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:53.823398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de1212-ad04-4b97-9379-e82e39def7ce None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:53.823723 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de1212-ad04-4b97-9379-e82e39def7ce None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:53.825158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 496/993] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:53.830660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9556-03c4-4b97-979c-21483ad4339a None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:53.830946 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9556-03c4-4b97-979c-21483ad4339a None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:53.831223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b9556-03c4-4b97-979c-21483ad4339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:53.850262 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-8c3b9556-03c4-4b97-979c-21483ad4339a None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:53.851377 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-8c3b9556-03c4-4b97-979c-21483ad4339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:53.868342 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69838715-a596-4812-82ed-60551e567a4f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:53.874379 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:53.905267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642315a-a6ae-4722-aff3-6d5313628a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:53.905874 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642315a-a6ae-4722-aff3-6d5313628a7b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:53.906187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642315a-a6ae-4722-aff3-6d5313628a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:53.906452 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642315a-a6ae-4722-aff3-6d5313628a7b None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:53.907077 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642315a-a6ae-4722-aff3-6d5313628a7b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:53.907371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642315a-a6ae-4722-aff3-6d5313628a7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:53.908771 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642315a-a6ae-4722-aff3-6d5313628a7b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:53.914160 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 498/994] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 07:12:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:53.919428 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642315a-a6ae-4722-aff3-6d5313628a7b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:53.923386 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 497/995] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:12:54.011465 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:54.020878 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642315a-a6ae-4722-aff3-6d5313628a7b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:54.055373 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f67ba6-8f23-4f35-8340-61a5a47f011d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:54.055970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f67ba6-8f23-4f35-8340-61a5a47f011d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:54.056244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f67ba6-8f23-4f35-8340-61a5a47f011d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:54.056508 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f67ba6-8f23-4f35-8340-61a5a47f011d None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:54.057124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f67ba6-8f23-4f35-8340-61a5a47f011d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:54.057418 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f67ba6-8f23-4f35-8340-61a5a47f011d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:54.058788 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f67ba6-8f23-4f35-8340-61a5a47f011d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:54.068332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 499/996] 10.222.0.16 () {56 vars in 1122 bytes} [Tue Aug 23 07:12:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:54.069345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b9556-03c4-4b97-979c-21483ad4339a None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:54.167781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b9556-03c4-4b97-979c-21483ad4339a None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:54.190915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f67ba6-8f23-4f35-8340-61a5a47f011d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:54.203379 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b9ca8-81f4-4437-84c6-7eb6e0b0cae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:54.204005 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b9ca8-81f4-4437-84c6-7eb6e0b0cae8 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:54.204272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b9ca8-81f4-4437-84c6-7eb6e0b0cae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:54.204538 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b9ca8-81f4-4437-84c6-7eb6e0b0cae8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:54.205204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b9ca8-81f4-4437-84c6-7eb6e0b0cae8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:54.206759 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b9ca8-81f4-4437-84c6-7eb6e0b0cae8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:54.276063 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 498/997] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 07:12:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:54.296941 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f67ba6-8f23-4f35-8340-61a5a47f011d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:54.345411 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fabddb-531e-44e0-be66-cf70084e84d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:54.346042 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fabddb-531e-44e0-be66-cf70084e84d0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:54.346346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fabddb-531e-44e0-be66-cf70084e84d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:54.346612 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fabddb-531e-44e0-be66-cf70084e84d0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:54.347214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fabddb-531e-44e0-be66-cf70084e84d0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:54.348652 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fabddb-531e-44e0-be66-cf70084e84d0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:54.357796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545458e-0232-44c8-8c3b-ce7c803fc776 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:54.358141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545458e-0232-44c8-8c3b-ce7c803fc776 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:54.358391 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545458e-0232-44c8-8c3b-ce7c803fc776 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-56fabddb-531e-44e0-be66-cf70084e84d0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:54.358926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:54.359887 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:12:54.363097 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:54.363851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 499/998] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:12:54.363923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 500/999] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 23 07:12:54 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:12:54.365604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807f9b3-a5a7-4a0c-bec8-ba4cbc982d99 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:54.365859 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807f9b3-a5a7-4a0c-bec8-ba4cbc982d99 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:54.366279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807f9b3-a5a7-4a0c-bec8-ba4cbc982d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:54.366565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fabddb-531e-44e0-be66-cf70084e84d0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:54.386827 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4807f9b3-a5a7-4a0c-bec8-ba4cbc982d99 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:54.387708 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:54.389038 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4807f9b3-a5a7-4a0c-bec8-ba4cbc982d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:54.402385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:54.472671 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 500/1000] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:54.481766 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fabddb-531e-44e0-be66-cf70084e84d0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:54.517275 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e05052-1873-4451-a501-deebd238fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:54.517872 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e05052-1873-4451-a501-deebd238fd6a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:54.518169 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e05052-1873-4451-a501-deebd238fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:54.518441 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e05052-1873-4451-a501-deebd238fd6a None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:54.519060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e05052-1873-4451-a501-deebd238fd6a None admin] RBAC: Adding query filter params (name=image) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:54.519353 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e05052-1873-4451-a501-deebd238fd6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:54.520707 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e05052-1873-4451-a501-deebd238fd6a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:54.530937 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 501/1001] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:54.532451 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807f9b3-a5a7-4a0c-bec8-ba4cbc982d99 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:54.639672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807f9b3-a5a7-4a0c-bec8-ba4cbc982d99 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:54.674064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261b7b-7de5-4ebb-987a-34fb3d4509b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:54.674855 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261b7b-7de5-4ebb-987a-34fb3d4509b8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:54.675134 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261b7b-7de5-4ebb-987a-34fb3d4509b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:54.675458 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e261b7b-7de5-4ebb-987a-34fb3d4509b8 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:54.676076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e261b7b-7de5-4ebb-987a-34fb3d4509b8 None admin] RBAC: Adding query filter params (type=image) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:54.676423 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e261b7b-7de5-4ebb-987a-34fb3d4509b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:54.677775 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e261b7b-7de5-4ebb-987a-34fb3d4509b8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:54.690132 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 501/1002] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:54.740783 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e05052-1873-4451-a501-deebd238fd6a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:54.834300 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:54.853937 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e05052-1873-4451-a501-deebd238fd6a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:54.890007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8cad3-dc6c-48e1-b351-fbbf79c56175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:54.890689 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8cad3-dc6c-48e1-b351-fbbf79c56175 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:54.890957 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8cad3-dc6c-48e1-b351-fbbf79c56175 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:54.891290 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8cad3-dc6c-48e1-b351-fbbf79c56175 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:54.891871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8cad3-dc6c-48e1-b351-fbbf79c56175 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:54.893210 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8cad3-dc6c-48e1-b351-fbbf79c56175 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-44e8cad3-dc6c-48e1-b351-fbbf79c56175 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:54.901931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:54.904713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:12:54.905558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 502/1003] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:54.909088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261b7b-7de5-4ebb-987a-34fb3d4509b8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:54.921703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:55.015798 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e261b7b-7de5-4ebb-987a-34fb3d4509b8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:55.049481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3a955-8bee-4147-97cb-43bd45a63a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:55.050085 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3a955-8bee-4147-97cb-43bd45a63a4a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:55.050390 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3a955-8bee-4147-97cb-43bd45a63a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:55.050660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3a955-8bee-4147-97cb-43bd45a63a4a None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:55.051274 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3a955-8bee-4147-97cb-43bd45a63a4a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:55.051604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3a955-8bee-4147-97cb-43bd45a63a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:55.052960 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3a955-8bee-4147-97cb-43bd45a63a4a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:55.062424 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 502/1004] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:55.063674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8cad3-dc6c-48e1-b351-fbbf79c56175 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:55.166332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8cad3-dc6c-48e1-b351-fbbf79c56175 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:55.203329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab5b72-3d3b-4bf6-b0fa-fdc1feda6aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:55.203929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5b72-3d3b-4bf6-b0fa-fdc1feda6aaf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:55.204209 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5b72-3d3b-4bf6-b0fa-fdc1feda6aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:55.204475 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab5b72-3d3b-4bf6-b0fa-fdc1feda6aaf None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:55.205105 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab5b72-3d3b-4bf6-b0fa-fdc1feda6aaf None admin] RBAC: Adding query filter params (type=compute) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:55.205403 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab5b72-3d3b-4bf6-b0fa-fdc1feda6aaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:55.206789 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab5b72-3d3b-4bf6-b0fa-fdc1feda6aaf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:55.217329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 503/1005] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:55.218907 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3a955-8bee-4147-97cb-43bd45a63a4a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:55.295835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:55.325618 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3a955-8bee-4147-97cb-43bd45a63a4a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:55.360845 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe24f44-a3bb-41be-835d-67eee3d4797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:55.361456 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe24f44-a3bb-41be-835d-67eee3d4797b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:55.361738 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe24f44-a3bb-41be-835d-67eee3d4797b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:55.362010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe24f44-a3bb-41be-835d-67eee3d4797b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:55.362735 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe24f44-a3bb-41be-835d-67eee3d4797b None admin] RBAC: Adding query filter params (interface=public, service_id=cf8b288e371d4748bbc7cffcbabd9af7, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:55.363044 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe24f44-a3bb-41be-835d-67eee3d4797b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:55.364404 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe24f44-a3bb-41be-835d-67eee3d4797b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:55.369739 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 503/1006] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 07:12:55 2022] GET /identity/v3/endpoints?service_id=cf8b288e371d4748bbc7cffcbabd9af7&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:55.376432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab5b72-3d3b-4bf6-b0fa-fdc1feda6aaf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:55.387383 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:55.479305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab5b72-3d3b-4bf6-b0fa-fdc1feda6aaf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:55.512309 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f501d59-2480-4af5-bad0-75c3abc002e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:55.512903 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501d59-2480-4af5-bad0-75c3abc002e7 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:55.513185 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501d59-2480-4af5-bad0-75c3abc002e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:55.514034 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f501d59-2480-4af5-bad0-75c3abc002e7 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:55.514666 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f501d59-2480-4af5-bad0-75c3abc002e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:55.516025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f501d59-2480-4af5-bad0-75c3abc002e7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:55.522298 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 504/1007] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 07:12:55 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 07:12:56.244915 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c57d31-df92-4ccb-8239-666acd5f3f52 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:56.245303 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c57d31-df92-4ccb-8239-666acd5f3f52 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:56.245512 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c57d31-df92-4ccb-8239-666acd5f3f52 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:56.246977 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 504/1008] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:56.252512 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139332-579b-4329-a2e0-1e812ee15b11 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:56.252801 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139332-579b-4329-a2e0-1e812ee15b11 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:56.253085 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d139332-579b-4329-a2e0-1e812ee15b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:56.271748 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8d139332-579b-4329-a2e0-1e812ee15b11 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:56.272924 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8d139332-579b-4329-a2e0-1e812ee15b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:56.340833 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 505/1009] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:56.609462 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c57d31-df92-4ccb-8239-666acd5f3f52 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:56.677056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2039c-6e7b-46fa-b33f-880b68608ce5 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:56.677594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2039c-6e7b-46fa-b33f-880b68608ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:56.677594 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2039c-6e7b-46fa-b33f-880b68608ce5 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:56.679122 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 506/1010] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:12:56.684060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac6f8-0643-4c52-85ea-42265c2964e0 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:56.684339 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac6f8-0643-4c52-85ea-42265c2964e0 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:56.684617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dac6f8-0643-4c52-85ea-42265c2964e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:56.692521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:56.705005 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-22dac6f8-0643-4c52-85ea-42265c2964e0 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:56.706223 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-22dac6f8-0643-4c52-85ea-42265c2964e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:56.717575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c57d31-df92-4ccb-8239-666acd5f3f52 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:56.756983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f2f6a-6d64-4ae4-a286-90914e9e7a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:56.757631 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f2f6a-6d64-4ae4-a286-90914e9e7a98 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:56.757892 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f2f6a-6d64-4ae4-a286-90914e9e7a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:56.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f2f6a-6d64-4ae4-a286-90914e9e7a98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:56.759295 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f2f6a-6d64-4ae4-a286-90914e9e7a98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:56.760721 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f2f6a-6d64-4ae4-a286-90914e9e7a98 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:56.762505 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 505/1011] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:56.767948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f2f6a-6d64-4ae4-a286-90914e9e7a98 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:56.772146 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:56.781905 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 507/1012] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:56 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:12:56.870981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f2f6a-6d64-4ae4-a286-90914e9e7a98 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:56.905835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe2f45-f313-47a5-8a4f-e3af86d01af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:56.906462 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe2f45-f313-47a5-8a4f-e3af86d01af8 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:56.906741 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe2f45-f313-47a5-8a4f-e3af86d01af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:56.907011 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe2f45-f313-47a5-8a4f-e3af86d01af8 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:56.907639 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe2f45-f313-47a5-8a4f-e3af86d01af8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:56.909143 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe2f45-f313-47a5-8a4f-e3af86d01af8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:57.015214 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 506/1013] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:12:56 2022] POST /identity/v3/projects => generated 311 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:12:57.050466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dac6f8-0643-4c52-85ea-42265c2964e0 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:57.159333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dac6f8-0643-4c52-85ea-42265c2964e0 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:57.192546 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:57.198607 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07065bea-1ce9-4821-bbd4-c6ac977ad84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:57.199214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07065bea-1ce9-4821-bbd4-c6ac977ad84d None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:57.199497 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07065bea-1ce9-4821-bbd4-c6ac977ad84d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:57.199763 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07065bea-1ce9-4821-bbd4-c6ac977ad84d None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:57.200408 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07065bea-1ce9-4821-bbd4-c6ac977ad84d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:57.201877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07065bea-1ce9-4821-bbd4-c6ac977ad84d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:57.281838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 508/1014] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:12:57 2022] POST /identity/v3/services => generated 242 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:57.443259 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040103fb-170e-4322-b488-7760e069d2de None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:57.443443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040103fb-170e-4322-b488-7760e069d2de None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:57.443720 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040103fb-170e-4322-b488-7760e069d2de None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:57.445073 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 507/1015] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:57.450692 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e658db-b8dd-4554-9542-6aef044c585a None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:57.451032 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e658db-b8dd-4554-9542-6aef044c585a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:57.451308 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e658db-b8dd-4554-9542-6aef044c585a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:57.470401 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-c3e658db-b8dd-4554-9542-6aef044c585a None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:57.471623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-c3e658db-b8dd-4554-9542-6aef044c585a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:57.548900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 509/1016] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:57 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:57.826623 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040103fb-170e-4322-b488-7760e069d2de None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:57.886760 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:57.932659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040103fb-170e-4322-b488-7760e069d2de None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:57.968724 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d260af-92ee-4fde-8638-cc00f87e1086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:57.969354 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d260af-92ee-4fde-8638-cc00f87e1086 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:57.969634 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d260af-92ee-4fde-8638-cc00f87e1086 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:57.969903 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d260af-92ee-4fde-8638-cc00f87e1086 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:57.970506 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d260af-92ee-4fde-8638-cc00f87e1086 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:57.971867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d260af-92ee-4fde-8638-cc00f87e1086 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-97d260af-92ee-4fde-8638-cc00f87e1086 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:57.980466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:57.981419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 07:12:57.982797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:57.989574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 508/1017] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:12:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:57.989723 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e658db-b8dd-4554-9542-6aef044c585a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:58.090008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e658db-b8dd-4554-9542-6aef044c585a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:58.107668 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:58.124488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c214634-5255-4634-86b8-4dcb8cd5fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:58.125114 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c214634-5255-4634-86b8-4dcb8cd5fc2b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:58.125397 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c214634-5255-4634-86b8-4dcb8cd5fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:58.125669 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c214634-5255-4634-86b8-4dcb8cd5fc2b None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:58.126329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c214634-5255-4634-86b8-4dcb8cd5fc2b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:58.126632 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c214634-5255-4634-86b8-4dcb8cd5fc2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:58.128000 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c214634-5255-4634-86b8-4dcb8cd5fc2b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:58.133170 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 510/1018] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:58.139581 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d260af-92ee-4fde-8638-cc00f87e1086 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:58.242803 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d260af-92ee-4fde-8638-cc00f87e1086 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:58.262682 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:58.276889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5717568-18bd-4df9-950c-182d7af8a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:58.277501 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5717568-18bd-4df9-950c-182d7af8a530 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:58.277852 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5717568-18bd-4df9-950c-182d7af8a530 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:58.278158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5717568-18bd-4df9-950c-182d7af8a530 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:58.279299 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5717568-18bd-4df9-950c-182d7af8a530 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:58.279603 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5717568-18bd-4df9-950c-182d7af8a530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:58.280955 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5717568-18bd-4df9-950c-182d7af8a530 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:58.290557 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 509/1019] 10.222.0.16 () {56 vars in 1112 bytes} [Tue Aug 23 07:12:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:58.291808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c214634-5255-4634-86b8-4dcb8cd5fc2b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:58.396931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c214634-5255-4634-86b8-4dcb8cd5fc2b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:58.429866 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7c290-e021-4e05-8a2d-3b0d15830f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:58.430616 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7c290-e021-4e05-8a2d-3b0d15830f98 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:58.430898 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7c290-e021-4e05-8a2d-3b0d15830f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:58.431223 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7c290-e021-4e05-8a2d-3b0d15830f98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:58.431875 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7c290-e021-4e05-8a2d-3b0d15830f98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:58.433236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd7c290-e021-4e05-8a2d-3b0d15830f98 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:58.527096 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 511/1020] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 07:12:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:58.984800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94166629-293d-43cb-8d54-9fdfe532a3c7 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:58.985350 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94166629-293d-43cb-8d54-9fdfe532a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:58.985350 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94166629-293d-43cb-8d54-9fdfe532a3c7 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:58.986851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 510/1021] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:58.992011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eaf2e-aaf9-41e2-ae1a-6c38abbccfcf None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:58.992394 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eaf2e-aaf9-41e2-ae1a-6c38abbccfcf None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:58.992573 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eaf2e-aaf9-41e2-ae1a-6c38abbccfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:59.010726 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-6f8eaf2e-aaf9-41e2-ae1a-6c38abbccfcf None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:59.011895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-6f8eaf2e-aaf9-41e2-ae1a-6c38abbccfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:59.042339 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:59.088651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 512/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:59.210660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4de4e-9f5d-4dae-bf07-f87bf2352a32 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:59.211014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4de4e-9f5d-4dae-bf07-f87bf2352a32 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:59.211212 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4de4e-9f5d-4dae-bf07-f87bf2352a32 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:59.212689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 511/1023] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:12:59.218153 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a443b-ce4f-48cc-9090-65f7de5eeabd None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:59.218443 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a443b-ce4f-48cc-9090-65f7de5eeabd None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:59.218714 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a443b-ce4f-48cc-9090-65f7de5eeabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:59.236749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-811a443b-ce4f-48cc-9090-65f7de5eeabd None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:12:59.237832 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-811a443b-ce4f-48cc-9090-65f7de5eeabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:12:59.304699 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 513/1024] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:12:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:12:59.357742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4de4e-9f5d-4dae-bf07-f87bf2352a32 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:59.460084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de4de4e-9f5d-4dae-bf07-f87bf2352a32 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:59.493838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e61361-fd33-4186-afba-e28b408e7001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:59.494413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e61361-fd33-4186-afba-e28b408e7001 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:59.494692 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e61361-fd33-4186-afba-e28b408e7001 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:59.494960 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e61361-fd33-4186-afba-e28b408e7001 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:59.496057 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e61361-fd33-4186-afba-e28b408e7001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:59.498082 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e61361-fd33-4186-afba-e28b408e7001 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:59.499958 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 512/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:12:59.505371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a443b-ce4f-48cc-9090-65f7de5eeabd None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:59.573193 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e61361-fd33-4186-afba-e28b408e7001 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:59.608680 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:59.614606 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a443b-ce4f-48cc-9090-65f7de5eeabd None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:59.637517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:59.650486 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d160c5d-f6c8-44d8-98f1-7f9c8cb1caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:59.651140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d160c5d-f6c8-44d8-98f1-7f9c8cb1caaa None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:59.656370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d160c5d-f6c8-44d8-98f1-7f9c8cb1caaa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:59.656370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d160c5d-f6c8-44d8-98f1-7f9c8cb1caaa None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:59.656370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d160c5d-f6c8-44d8-98f1-7f9c8cb1caaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:59.656370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d160c5d-f6c8-44d8-98f1-7f9c8cb1caaa None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:59.686756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e61361-fd33-4186-afba-e28b408e7001 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:59.722909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc92cc3-362f-44aa-8197-125abf0162c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:59.723544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92cc3-362f-44aa-8197-125abf0162c0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:59.723826 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92cc3-362f-44aa-8197-125abf0162c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:59.724098 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc92cc3-362f-44aa-8197-125abf0162c0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:59.724701 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc92cc3-362f-44aa-8197-125abf0162c0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:59.726175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc92cc3-362f-44aa-8197-125abf0162c0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-cbc92cc3-362f-44aa-8197-125abf0162c0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:12:59.735473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:12:59.736748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:12:59.737584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 513/1026] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 23 07:12:59 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:12:59.742350 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc92cc3-362f-44aa-8197-125abf0162c0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:12:59.759713 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 514/1027] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:12:59 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:12:59.853553 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc92cc3-362f-44aa-8197-125abf0162c0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:12:59.871481 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:12:59.890711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44912b8-6d04-4a89-a09d-07b974f41f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:12:59.891515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44912b8-6d04-4a89-a09d-07b974f41f46 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:12:59.891799 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44912b8-6d04-4a89-a09d-07b974f41f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:12:59.892073 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44912b8-6d04-4a89-a09d-07b974f41f46 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:12:59.892706 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44912b8-6d04-4a89-a09d-07b974f41f46 None admin] RBAC: Adding query filter params (name=image) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:12:59.893010 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44912b8-6d04-4a89-a09d-07b974f41f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:12:59.894404 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44912b8-6d04-4a89-a09d-07b974f41f46 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:12:59.899719 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 514/1028] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:12:59.905981 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d160c5d-f6c8-44d8-98f1-7f9c8cb1caaa None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:00.016377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d160c5d-f6c8-44d8-98f1-7f9c8cb1caaa None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:00.050354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d394eb6-74ad-42ec-b68a-e81bfb4e6daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:00.050958 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d394eb6-74ad-42ec-b68a-e81bfb4e6daf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:00.051234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d394eb6-74ad-42ec-b68a-e81bfb4e6daf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:00.051501 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d394eb6-74ad-42ec-b68a-e81bfb4e6daf None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:00.052134 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d394eb6-74ad-42ec-b68a-e81bfb4e6daf None admin] RBAC: Adding query filter params (type=image) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:00.052435 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d394eb6-74ad-42ec-b68a-e81bfb4e6daf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:00.053800 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d394eb6-74ad-42ec-b68a-e81bfb4e6daf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:00.063748 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 515/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:12:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:13:00.065393 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44912b8-6d04-4a89-a09d-07b974f41f46 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:00.171067 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44912b8-6d04-4a89-a09d-07b974f41f46 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:00.205655 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49305eae-c662-426c-ba55-d532eece78bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:00.206291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305eae-c662-426c-ba55-d532eece78bd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:00.206572 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305eae-c662-426c-ba55-d532eece78bd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:00.206843 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49305eae-c662-426c-ba55-d532eece78bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:00.207537 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49305eae-c662-426c-ba55-d532eece78bd None admin] RBAC: Adding query filter params (interface=public, service_id=4dc44dc8383d4fbb9b6492fb576b4715, region_id=RegionOne) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:00.207842 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49305eae-c662-426c-ba55-d532eece78bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:00.209189 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49305eae-c662-426c-ba55-d532eece78bd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:00.218187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 515/1030] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 07:13:00 2022] GET /identity/v3/endpoints?service_id=4dc44dc8383d4fbb9b6492fb576b4715&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:00.221342 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d394eb6-74ad-42ec-b68a-e81bfb4e6daf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:00.238666 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:00.324154 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d394eb6-74ad-42ec-b68a-e81bfb4e6daf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:00.358233 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054b27d-1010-45ee-8659-8a9e3b1020cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:00.358832 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054b27d-1010-45ee-8659-8a9e3b1020cd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:00.359106 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054b27d-1010-45ee-8659-8a9e3b1020cd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:00.359372 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054b27d-1010-45ee-8659-8a9e3b1020cd None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:00.359972 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054b27d-1010-45ee-8659-8a9e3b1020cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:00.361375 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054b27d-1010-45ee-8659-8a9e3b1020cd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:00.374186 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 516/1031] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 07:13:00 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 07:13:00.548882 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686292ad-137c-4607-8e5c-7d99f7edc635 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:00.549225 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686292ad-137c-4607-8e5c-7d99f7edc635 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:00.549427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686292ad-137c-4607-8e5c-7d99f7edc635 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:00.550959 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 516/1032] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:00.555850 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a3c1-0ac3-4eaf-8fa4-6b15494187eb None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:00.556135 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a3c1-0ac3-4eaf-8fa4-6b15494187eb None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:00.556404 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a3c1-0ac3-4eaf-8fa4-6b15494187eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:00.574471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d934a3c1-0ac3-4eaf-8fa4-6b15494187eb None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:00.575651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d934a3c1-0ac3-4eaf-8fa4-6b15494187eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:00.647205 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 517/1033] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:00.916515 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686292ad-137c-4607-8e5c-7d99f7edc635 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:00.963527 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:01.020497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686292ad-137c-4607-8e5c-7d99f7edc635 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:01.054464 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf92a91-8b1e-4b99-ae97-f42d94249604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:01.055078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf92a91-8b1e-4b99-ae97-f42d94249604 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:01.055354 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf92a91-8b1e-4b99-ae97-f42d94249604 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:01.055619 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf92a91-8b1e-4b99-ae97-f42d94249604 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:01.065626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf92a91-8b1e-4b99-ae97-f42d94249604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-bbf92a91-8b1e-4b99-ae97-f42d94249604 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:01.070251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:01.071396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:01.072437 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 517/1034] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 07:13:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:01.077963 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934a3c1-0ac3-4eaf-8fa4-6b15494187eb None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:01.088134 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:01.183647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934a3c1-0ac3-4eaf-8fa4-6b15494187eb None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:01.218046 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c2cbd-41c4-4ec2-b14d-9e53b7fa4496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:01.218686 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2cbd-41c4-4ec2-b14d-9e53b7fa4496 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:01.218963 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2cbd-41c4-4ec2-b14d-9e53b7fa4496 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:01.219230 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c2cbd-41c4-4ec2-b14d-9e53b7fa4496 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:01.219886 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c2cbd-41c4-4ec2-b14d-9e53b7fa4496 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:01.220183 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c2cbd-41c4-4ec2-b14d-9e53b7fa4496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:01.221525 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c2cbd-41c4-4ec2-b14d-9e53b7fa4496 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:01.234280 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 518/1035] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 07:13:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:01.235589 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf92a91-8b1e-4b99-ae97-f42d94249604 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:01.340172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf92a91-8b1e-4b99-ae97-f42d94249604 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:01.344291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:01.376761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d31553-fc0f-4466-aa0a-a053da300d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:01.377393 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d31553-fc0f-4466-aa0a-a053da300d53 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:01.377673 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d31553-fc0f-4466-aa0a-a053da300d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:01.377952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d31553-fc0f-4466-aa0a-a053da300d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:01.388278 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d31553-fc0f-4466-aa0a-a053da300d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:01.389912 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d31553-fc0f-4466-aa0a-a053da300d53 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-57d31553-fc0f-4466-aa0a-a053da300d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:13:01.405155 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:01.406418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:13:01.407330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:13:01.407330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:01.407330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:01.407933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 518/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:01.412162 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c2cbd-41c4-4ec2-b14d-9e53b7fa4496 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:01.486190 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:01.518597 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c2cbd-41c4-4ec2-b14d-9e53b7fa4496 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:01.551725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f0cdb-4a96-40b1-abb8-ce365b6fa9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:01.552323 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f0cdb-4a96-40b1-abb8-ce365b6fa9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:01.552598 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f0cdb-4a96-40b1-abb8-ce365b6fa9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:01.552865 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f0cdb-4a96-40b1-abb8-ce365b6fa9f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:01.553496 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f0cdb-4a96-40b1-abb8-ce365b6fa9f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:01.553791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f0cdb-4a96-40b1-abb8-ce365b6fa9f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:01.555231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f0cdb-4a96-40b1-abb8-ce365b6fa9f1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:01.568337 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 519/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:01.573705 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d31553-fc0f-4466-aa0a-a053da300d53 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:01.678067 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d31553-fc0f-4466-aa0a-a053da300d53 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:01.712092 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981132f1-d611-4a4a-83c2-0b9fd267bacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:01.712956 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981132f1-d611-4a4a-83c2-0b9fd267bacf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:01.713233 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981132f1-d611-4a4a-83c2-0b9fd267bacf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:01.713497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981132f1-d611-4a4a-83c2-0b9fd267bacf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:01.721342 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981132f1-d611-4a4a-83c2-0b9fd267bacf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:01.722793 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981132f1-d611-4a4a-83c2-0b9fd267bacf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-981132f1-d611-4a4a-83c2-0b9fd267bacf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:13:01.734544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:01.735575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:01.737075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:01.737075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:01.737075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:13:01.737075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:13:01.737075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:13:01.737075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:13:01.737075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:13:01.737075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:13:01.737075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:13:01.737075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:01.737971 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 519/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 07:13:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:01.741673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f0cdb-4a96-40b1-abb8-ce365b6fa9f1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:01.744708 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884268d-59cd-4c2e-8415-7e6756efcb9f None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:01.744998 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884268d-59cd-4c2e-8415-7e6756efcb9f None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:01.745280 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7884268d-59cd-4c2e-8415-7e6756efcb9f None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:01.746612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 520/1039] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:13:01.752818 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d3ccf-8407-4d7a-9f3f-b0de4ff6ba3d None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:01.753110 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d3ccf-8407-4d7a-9f3f-b0de4ff6ba3d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:01.753391 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d3ccf-8407-4d7a-9f3f-b0de4ff6ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:01.772018 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5b5d3ccf-8407-4d7a-9f3f-b0de4ff6ba3d None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:01.773214 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5b5d3ccf-8407-4d7a-9f3f-b0de4ff6ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:01.785575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:01.844567 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 521/1040] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:13:01.847290 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f0cdb-4a96-40b1-abb8-ce365b6fa9f1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:01.877416 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:01.883816 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e73aa-2921-42f6-825d-eef53d836e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:01.884424 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e73aa-2921-42f6-825d-eef53d836e50 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:01.884762 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e73aa-2921-42f6-825d-eef53d836e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:01.885040 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e73aa-2921-42f6-825d-eef53d836e50 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:01.885764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e73aa-2921-42f6-825d-eef53d836e50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:01.886061 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e73aa-2921-42f6-825d-eef53d836e50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:01.888774 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e73aa-2921-42f6-825d-eef53d836e50 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:01.909434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 520/1041] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 07:13:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:01.911096 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d3ccf-8407-4d7a-9f3f-b0de4ff6ba3d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:02.016465 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d3ccf-8407-4d7a-9f3f-b0de4ff6ba3d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:02.051172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181e3f6-ae56-4188-ac22-9ee7f3479cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:02.051781 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e3f6-ae56-4188-ac22-9ee7f3479cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:02.052061 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e3f6-ae56-4188-ac22-9ee7f3479cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:02.052333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181e3f6-ae56-4188-ac22-9ee7f3479cd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:02.068310 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:02.116210 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e73aa-2921-42f6-825d-eef53d836e50 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:02.123792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181e3f6-ae56-4188-ac22-9ee7f3479cd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:02.125249 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181e3f6-ae56-4188-ac22-9ee7f3479cd2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:02.222793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e73aa-2921-42f6-825d-eef53d836e50 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:02.233907 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 522/1042] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:01 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:13:02.239220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181e3f6-ae56-4188-ac22-9ee7f3479cd2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:02.264079 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dad15-2686-43e7-817f-e5234a4a1e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:02.264701 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dad15-2686-43e7-817f-e5234a4a1e57 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:02.264979 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dad15-2686-43e7-817f-e5234a4a1e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:02.265245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dad15-2686-43e7-817f-e5234a4a1e57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:02.275495 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008dad15-2686-43e7-817f-e5234a4a1e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-008dad15-2686-43e7-817f-e5234a4a1e57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:02.280179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:02.281121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:13:02.283011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 521/1043] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:13:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:13:02.287100 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dad15-2686-43e7-817f-e5234a4a1e57 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:02.295863 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:02.340054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:02.349240 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181e3f6-ae56-4188-ac22-9ee7f3479cd2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:02.385121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65668ef5-f765-4d6d-bfdd-133741fa49c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:02.385835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65668ef5-f765-4d6d-bfdd-133741fa49c8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:02.386137 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65668ef5-f765-4d6d-bfdd-133741fa49c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:02.386411 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65668ef5-f765-4d6d-bfdd-133741fa49c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:02.390451 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008dad15-2686-43e7-817f-e5234a4a1e57 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:02.397588 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65668ef5-f765-4d6d-bfdd-133741fa49c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:02.399064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65668ef5-f765-4d6d-bfdd-133741fa49c8 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-65668ef5-f765-4d6d-bfdd-133741fa49c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:13:02.413255 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:02.414364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:13:02.415261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:13:02.415261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:02.415261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:02.415261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 523/1044] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:13:02.415909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663049c1-ab8b-46c7-bfba-4152e6c7880c None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:02.416065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663049c1-ab8b-46c7-bfba-4152e6c7880c None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:02.416327 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663049c1-ab8b-46c7-bfba-4152e6c7880c None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:02.417699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 524/1045] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:02.420359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663049c1-ab8b-46c7-bfba-4152e6c7880c None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:02.427911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137dd74-fef5-43c2-84fd-2cc0b66b50ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:02.428509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137dd74-fef5-43c2-84fd-2cc0b66b50ea None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:02.428789 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137dd74-fef5-43c2-84fd-2cc0b66b50ea None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:02.429052 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137dd74-fef5-43c2-84fd-2cc0b66b50ea None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:02.429719 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137dd74-fef5-43c2-84fd-2cc0b66b50ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:02.430017 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137dd74-fef5-43c2-84fd-2cc0b66b50ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:02.431461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137dd74-fef5-43c2-84fd-2cc0b66b50ea None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:02.440486 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 522/1046] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:13:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:13:02.441693 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22980ee2-e4d6-4522-98c8-f0b3864e7b40 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:02.441979 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22980ee2-e4d6-4522-98c8-f0b3864e7b40 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:02.442285 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22980ee2-e4d6-4522-98c8-f0b3864e7b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:02.459471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-22980ee2-e4d6-4522-98c8-f0b3864e7b40 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:02.460647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-22980ee2-e4d6-4522-98c8-f0b3864e7b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:02.517108 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:02.521722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663049c1-ab8b-46c7-bfba-4152e6c7880c None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:02.541146 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 523/1047] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:02.541146 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22980ee2-e4d6-4522-98c8-f0b3864e7b40 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:02.555819 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d42fc-e814-4ec1-8726-9e025015dfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:02.556417 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d42fc-e814-4ec1-8726-9e025015dfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:02.556692 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d42fc-e814-4ec1-8726-9e025015dfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:02.556964 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d42fc-e814-4ec1-8726-9e025015dfe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:02.557587 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d42fc-e814-4ec1-8726-9e025015dfe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:02.557882 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d42fc-e814-4ec1-8726-9e025015dfe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:02.559524 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d42fc-e814-4ec1-8726-9e025015dfe5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:02.572185 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:02.576811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 525/1048] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:13:02.577576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d42fc-e814-4ec1-8726-9e025015dfe5 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:02.644078 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22980ee2-e4d6-4522-98c8-f0b3864e7b40 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:02.679549 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01aadb-ee0b-421e-970c-5fffbb7fef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:02.680420 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01aadb-ee0b-421e-970c-5fffbb7fef6d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:02.680853 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01aadb-ee0b-421e-970c-5fffbb7fef6d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:02.681126 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a01aadb-ee0b-421e-970c-5fffbb7fef6d None admin] PATH_INFO: `/v3/users/7b7c93376ab140a5b27bb7eb39533a16` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:02.683299 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d42fc-e814-4ec1-8726-9e025015dfe5 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:02.695909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01aadb-ee0b-421e-970c-5fffbb7fef6d None admin] RBAC: Authorizing `identity:get_user(user_id=7b7c93376ab140a5b27bb7eb39533a16)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:02.697344 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a01aadb-ee0b-421e-970c-5fffbb7fef6d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:02.699163 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 524/1049] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:02 2022] GET /identity/v3/users/7b7c93376ab140a5b27bb7eb39533a16 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:02.705250 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01aadb-ee0b-421e-970c-5fffbb7fef6d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:02.719973 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934c4df-5c60-4a85-98f9-02ade1ac83c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:02.720596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934c4df-5c60-4a85-98f9-02ade1ac83c4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:02.720870 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934c4df-5c60-4a85-98f9-02ade1ac83c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:02.721127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934c4df-5c60-4a85-98f9-02ade1ac83c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:02.727813 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934c4df-5c60-4a85-98f9-02ade1ac83c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:02.729228 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934c4df-5c60-4a85-98f9-02ade1ac83c4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e934c4df-5c60-4a85-98f9-02ade1ac83c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:13:02.741432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:02.742443 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:02.743331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:13:02.743331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:13:02.743331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:13:02.743331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:13:02.743331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:13:02.743331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:13:02.743331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:13:02.743331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:02.743331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 526/1050] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:13:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:02.748337 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934c4df-5c60-4a85-98f9-02ade1ac83c4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:02.767582 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:02.811821 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:02.815504 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a01aadb-ee0b-421e-970c-5fffbb7fef6d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:02.849729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec058d-b663-46ca-b47d-cdf55f83a07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:02.850349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec058d-b663-46ca-b47d-cdf55f83a07d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:02.850651 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec058d-b663-46ca-b47d-cdf55f83a07d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:02.850926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec058d-b663-46ca-b47d-cdf55f83a07d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:02.851510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934c4df-5c60-4a85-98f9-02ade1ac83c4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:02.884966 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee0604-27fc-4c44-8b01-6fbe2cd789e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:02.885572 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee0604-27fc-4c44-8b01-6fbe2cd789e3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:02.885851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee0604-27fc-4c44-8b01-6fbe2cd789e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:02.886150 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee0604-27fc-4c44-8b01-6fbe2cd789e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:02.886839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee0604-27fc-4c44-8b01-6fbe2cd789e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:02.887142 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee0604-27fc-4c44-8b01-6fbe2cd789e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:02.889218 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee0604-27fc-4c44-8b01-6fbe2cd789e3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:02.900522 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 527/1051] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:13:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:13:02.901630 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee0604-27fc-4c44-8b01-6fbe2cd789e3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:02.921260 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec058d-b663-46ca-b47d-cdf55f83a07d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:02.922732 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec058d-b663-46ca-b47d-cdf55f83a07d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:02.980704 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:03.002580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee0604-27fc-4c44-8b01-6fbe2cd789e3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:03.017293 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:03.021436 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 525/1052] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 07:13:03.022263 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec058d-b663-46ca-b47d-cdf55f83a07d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:03.036981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e12f-0694-4f9f-9fa5-93ff14928e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:03.037604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e12f-0694-4f9f-9fa5-93ff14928e45 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:03.037882 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e12f-0694-4f9f-9fa5-93ff14928e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:03.038225 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37e12f-0694-4f9f-9fa5-93ff14928e45 None admin] PATH_INFO: `/v3/services/image` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:03.038792 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37e12f-0694-4f9f-9fa5-93ff14928e45 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:03.040150 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37e12f-0694-4f9f-9fa5-93ff14928e45 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1d37e12f-0694-4f9f-9fa5-93ff14928e45 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:03.049156 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:03.050373 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:03.051645 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 528/1053] 10.222.0.16 () {56 vars in 1105 bytes} [Tue Aug 23 07:13:02 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:03.052431 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e12f-0694-4f9f-9fa5-93ff14928e45 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:03.125582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec058d-b663-46ca-b47d-cdf55f83a07d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:03.151490 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37e12f-0694-4f9f-9fa5-93ff14928e45 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:03.163048 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc860b8-5583-485a-bbdd-e05177df0cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:03.163638 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc860b8-5583-485a-bbdd-e05177df0cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:03.163919 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc860b8-5583-485a-bbdd-e05177df0cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:03.164187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc860b8-5583-485a-bbdd-e05177df0cf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:03.164900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc860b8-5583-485a-bbdd-e05177df0cf1 None admin] RBAC: Adding query filter params (role.id=07dc752249564549bf2144d8dc2d4ca1, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=bb99f54d9320496cbcc52d535fa64789) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:03.165212 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc860b8-5583-485a-bbdd-e05177df0cf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:03.166650 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc860b8-5583-485a-bbdd-e05177df0cf1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:03.172729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 526/1054] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:13:03 2022] GET /identity/v3/role_assignments?user.id=bb99f54d9320496cbcc52d535fa64789&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=07dc752249564549bf2144d8dc2d4ca1 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:03.173489 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc860b8-5583-485a-bbdd-e05177df0cf1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:03.187264 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d23c02-871c-453a-9ac0-df69f9cc95b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:03.187927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d23c02-871c-453a-9ac0-df69f9cc95b3 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:03.188207 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d23c02-871c-453a-9ac0-df69f9cc95b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:03.188477 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d23c02-871c-453a-9ac0-df69f9cc95b3 None admin] PATH_INFO: `/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:03.189692 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d23c02-871c-453a-9ac0-df69f9cc95b3 None admin] RBAC: Authorizing `identity:get_project(project_id=48b8b4a6eef145c4af6cb976ae8187fe)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:03.191200 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d23c02-871c-453a-9ac0-df69f9cc95b3 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:03.193122 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 529/1055] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:03 2022] GET /identity/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:03.199508 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d23c02-871c-453a-9ac0-df69f9cc95b3 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:03.213772 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:03.256361 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:03.304472 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc860b8-5583-485a-bbdd-e05177df0cf1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:03.313358 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d23c02-871c-453a-9ac0-df69f9cc95b3 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:03.344241 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45993f5-8452-473f-9e34-3cfb66decaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:03.344847 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45993f5-8452-473f-9e34-3cfb66decaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:03.345120 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45993f5-8452-473f-9e34-3cfb66decaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:03.345399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45993f5-8452-473f-9e34-3cfb66decaa2 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:03.346027 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45993f5-8452-473f-9e34-3cfb66decaa2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:03.346357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45993f5-8452-473f-9e34-3cfb66decaa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:03.347722 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45993f5-8452-473f-9e34-3cfb66decaa2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:03.351621 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032e302-c73b-48ce-9741-c37de76f7c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:03.352228 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032e302-c73b-48ce-9741-c37de76f7c17 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:03.352504 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032e302-c73b-48ce-9741-c37de76f7c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:03.352772 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032e302-c73b-48ce-9741-c37de76f7c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:03.353493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032e302-c73b-48ce-9741-c37de76f7c17 None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=48b8b4a6eef145c4af6cb976ae8187fe, user.id=7b7c93376ab140a5b27bb7eb39533a16) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:03.353797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032e302-c73b-48ce-9741-c37de76f7c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:03.355240 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032e302-c73b-48ce-9741-c37de76f7c17 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:03.357952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 527/1056] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:03.358857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45993f5-8452-473f-9e34-3cfb66decaa2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:03.366163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 530/1057] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:13:03 2022] GET /identity/v3/role_assignments?user.id=7b7c93376ab140a5b27bb7eb39533a16&scope.project.id=48b8b4a6eef145c4af6cb976ae8187fe&role.id=afe88bc03d30494b89892587177c79de => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:13:03.475139 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45993f5-8452-473f-9e34-3cfb66decaa2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:03.502872 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:03.512647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfd4f0-8c2e-4036-b800-011bb7ba1a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:03.518461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd4f0-8c2e-4036-b800-011bb7ba1a73 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:03.518461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd4f0-8c2e-4036-b800-011bb7ba1a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:03.518461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd4f0-8c2e-4036-b800-011bb7ba1a73 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:03.518461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfd4f0-8c2e-4036-b800-011bb7ba1a73 None admin] RBAC: Adding query filter params (type=image) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:03.518461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfd4f0-8c2e-4036-b800-011bb7ba1a73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:03.518461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfd4f0-8c2e-4036-b800-011bb7ba1a73 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:03.526129 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 528/1058] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:03.529151 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032e302-c73b-48ce-9741-c37de76f7c17 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:03.617952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:03.643897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032e302-c73b-48ce-9741-c37de76f7c17 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:03.678360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a66544-8ae1-4425-9073-92c30c5fc5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:03.678967 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66544-8ae1-4425-9073-92c30c5fc5bd None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:03.679241 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66544-8ae1-4425-9073-92c30c5fc5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:03.679510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a66544-8ae1-4425-9073-92c30c5fc5bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:03.680169 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a66544-8ae1-4425-9073-92c30c5fc5bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:03.681517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a66544-8ae1-4425-9073-92c30c5fc5bd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:03.786219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 531/1059] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 07:13:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:13:05.079791 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05811f-cd4b-44da-a502-481bbb9166b5 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:05.080328 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05811f-cd4b-44da-a502-481bbb9166b5 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:05.080328 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05811f-cd4b-44da-a502-481bbb9166b5 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:05.081703 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 529/1060] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:05.086936 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e942-5e78-4321-84a6-cf49ea8c2009 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:05.087364 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e942-5e78-4321-84a6-cf49ea8c2009 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:05.087766 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3004e942-5e78-4321-84a6-cf49ea8c2009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:05.107073 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3004e942-5e78-4321-84a6-cf49ea8c2009 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:05.108266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3004e942-5e78-4321-84a6-cf49ea8c2009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:05.184133 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 532/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:05.270991 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466949d5-fd07-41ac-82fd-c6689b846b72 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:05.271310 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466949d5-fd07-41ac-82fd-c6689b846b72 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:05.271537 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466949d5-fd07-41ac-82fd-c6689b846b72 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:05.274142 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 530/1062] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:05.278183 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c7012-2068-40b8-a03a-768997e7b181 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:05.278542 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c7012-2068-40b8-a03a-768997e7b181 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:05.278823 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c7012-2068-40b8-a03a-768997e7b181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:05.297161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2c7c7012-2068-40b8-a03a-768997e7b181 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:05.298411 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2c7c7012-2068-40b8-a03a-768997e7b181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:05.349978 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:05.367224 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 533/1063] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:05.456573 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466949d5-fd07-41ac-82fd-c6689b846b72 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:05.558380 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466949d5-fd07-41ac-82fd-c6689b846b72 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:05.596086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8547b63-183b-49dd-87b6-73b3f854fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:05.596722 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547b63-183b-49dd-87b6-73b3f854fb43 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:05.596992 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547b63-183b-49dd-87b6-73b3f854fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:05.597255 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8547b63-183b-49dd-87b6-73b3f854fb43 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:05.608620 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8547b63-183b-49dd-87b6-73b3f854fb43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e8547b63-183b-49dd-87b6-73b3f854fb43 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:05.613200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:05.614167 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:13:05.615025 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:13:05.616267 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 531/1064] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 07:13:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:05.620455 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c7012-2068-40b8-a03a-768997e7b181 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:05.650469 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8547b63-183b-49dd-87b6-73b3f854fb43 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:05.705034 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:05.729145 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c7012-2068-40b8-a03a-768997e7b181 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:05.759118 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8547b63-183b-49dd-87b6-73b3f854fb43 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:05.763549 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525df4a2-955d-42d3-bb4d-569d020668d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:05.764148 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df4a2-955d-42d3-bb4d-569d020668d7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:05.764427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df4a2-955d-42d3-bb4d-569d020668d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:05.764696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525df4a2-955d-42d3-bb4d-569d020668d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:05.765355 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525df4a2-955d-42d3-bb4d-569d020668d7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:05.765652 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525df4a2-955d-42d3-bb4d-569d020668d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:05.767042 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525df4a2-955d-42d3-bb4d-569d020668d7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:05.774871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 534/1065] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 07:13:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:05.776015 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fecd8-6a81-4c21-a5ff-97d0202426a0 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:05.776301 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fecd8-6a81-4c21-a5ff-97d0202426a0 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:05.776574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fecd8-6a81-4c21-a5ff-97d0202426a0 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:05.777762 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 535/1066] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:05.781238 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fecd8-6a81-4c21-a5ff-97d0202426a0 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:05.795657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19897893-9fc5-4f98-bc89-32102a9e39fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:05.796360 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19897893-9fc5-4f98-bc89-32102a9e39fa None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:05.796640 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19897893-9fc5-4f98-bc89-32102a9e39fa None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:05.796909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19897893-9fc5-4f98-bc89-32102a9e39fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:05.806972 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19897893-9fc5-4f98-bc89-32102a9e39fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-19897893-9fc5-4f98-bc89-32102a9e39fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:05.812270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:05.813234 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:13:05.814087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 532/1067] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:13:05.814829 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36edc1-8ad8-473b-9284-f76189854b75 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:05.814829 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36edc1-8ad8-473b-9284-f76189854b75 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:05.815015 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36edc1-8ad8-473b-9284-f76189854b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:05.832207 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-7b36edc1-8ad8-473b-9284-f76189854b75 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:05.833390 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-7b36edc1-8ad8-473b-9284-f76189854b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:05.835063 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:05.888868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fecd8-6a81-4c21-a5ff-97d0202426a0 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:05.900370 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 533/1068] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:05.901279 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36edc1-8ad8-473b-9284-f76189854b75 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:05.925860 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b262efd-e871-4111-b7aa-e8396e80f590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:05.926527 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262efd-e871-4111-b7aa-e8396e80f590 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:05.926802 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262efd-e871-4111-b7aa-e8396e80f590 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:05.927075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b262efd-e871-4111-b7aa-e8396e80f590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:05.937495 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b262efd-e871-4111-b7aa-e8396e80f590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:05.948493 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b262efd-e871-4111-b7aa-e8396e80f590 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:05.949819 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1b262efd-e871-4111-b7aa-e8396e80f590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:13:05.953457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:05.954503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:13:05.960970 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:13:05.960970 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:05.960970 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:05.960970 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 536/1069] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:13:05.961215 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b262efd-e871-4111-b7aa-e8396e80f590 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:06.018815 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36edc1-8ad8-473b-9284-f76189854b75 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:06.057628 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155653cb-1456-4b65-98a8-4940978b855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:06.058288 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155653cb-1456-4b65-98a8-4940978b855c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:06.058566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155653cb-1456-4b65-98a8-4940978b855c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:06.058836 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155653cb-1456-4b65-98a8-4940978b855c None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:06.059533 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155653cb-1456-4b65-98a8-4940978b855c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:06.059833 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155653cb-1456-4b65-98a8-4940978b855c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:06.061251 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155653cb-1456-4b65-98a8-4940978b855c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:06.063538 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:06.066321 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b262efd-e871-4111-b7aa-e8396e80f590 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:06.070599 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 534/1070] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:06.076711 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155653cb-1456-4b65-98a8-4940978b855c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:06.103052 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d1502-891a-4a51-94c7-07a61861e347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:06.103664 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d1502-891a-4a51-94c7-07a61861e347 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:06.103939 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d1502-891a-4a51-94c7-07a61861e347 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:06.104207 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d1502-891a-4a51-94c7-07a61861e347 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:06.104841 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d1502-891a-4a51-94c7-07a61861e347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:06.105139 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d1502-891a-4a51-94c7-07a61861e347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:06.106690 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d1502-891a-4a51-94c7-07a61861e347 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:06.123054 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 537/1071] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:13:06.124627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d1502-891a-4a51-94c7-07a61861e347 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:06.185971 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155653cb-1456-4b65-98a8-4940978b855c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:06.187744 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:06.227086 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d1502-891a-4a51-94c7-07a61861e347 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:06.269629 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe140f4a-1ecf-4643-947a-9b51394fbbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:06.269844 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ceed-6482-4955-b640-4c3c571f90ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:06.270286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe140f4a-1ecf-4643-947a-9b51394fbbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:06.270465 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ceed-6482-4955-b640-4c3c571f90ea None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:06.270575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe140f4a-1ecf-4643-947a-9b51394fbbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:06.270741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ceed-6482-4955-b640-4c3c571f90ea None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:06.270838 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe140f4a-1ecf-4643-947a-9b51394fbbd6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:06.271010 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f465ceed-6482-4955-b640-4c3c571f90ea None admin] PATH_INFO: `/v3/users/7b7c93376ab140a5b27bb7eb39533a16` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:06.272114 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465ceed-6482-4955-b640-4c3c571f90ea None admin] RBAC: Authorizing `identity:get_user(user_id=7b7c93376ab140a5b27bb7eb39533a16)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:06.273635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f465ceed-6482-4955-b640-4c3c571f90ea None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:06.275193 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 535/1072] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:06 2022] GET /identity/v3/users/7b7c93376ab140a5b27bb7eb39533a16 => generated 285 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:13:06.275943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ceed-6482-4955-b640-4c3c571f90ea None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:06.278999 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe140f4a-1ecf-4643-947a-9b51394fbbd6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:06.285797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe140f4a-1ecf-4643-947a-9b51394fbbd6 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-fe140f4a-1ecf-4643-947a-9b51394fbbd6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:13:06.292942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:06.294479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 538/1073] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 07:13:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:13:06.295507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe140f4a-1ecf-4643-947a-9b51394fbbd6 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:06.319457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:06.381189 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f465ceed-6482-4955-b640-4c3c571f90ea None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:06.399024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe140f4a-1ecf-4643-947a-9b51394fbbd6 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:06.413371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701af50d-309f-4646-b663-081c7635db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:06.413966 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701af50d-309f-4646-b663-081c7635db4f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:06.414292 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701af50d-309f-4646-b663-081c7635db4f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:06.414563 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701af50d-309f-4646-b663-081c7635db4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:06.432816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7845-70fd-465f-afed-b9b0a4940ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:06.433439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7845-70fd-465f-afed-b9b0a4940ddf None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:06.433718 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7845-70fd-465f-afed-b9b0a4940ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:06.433988 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6c7845-70fd-465f-afed-b9b0a4940ddf None admin] PATH_INFO: `/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:06.435786 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c7845-70fd-465f-afed-b9b0a4940ddf None admin] RBAC: Authorizing `identity:get_project(project_id=48b8b4a6eef145c4af6cb976ae8187fe)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:06.437277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6c7845-70fd-465f-afed-b9b0a4940ddf None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:06.438883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 539/1074] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:06 2022] GET /identity/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:06.439641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7845-70fd-465f-afed-b9b0a4940ddf None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:06.458094 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:06.487956 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701af50d-309f-4646-b663-081c7635db4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:06.489385 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701af50d-309f-4646-b663-081c7635db4f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:06.525575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:06.537751 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6c7845-70fd-465f-afed-b9b0a4940ddf None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:06.571518 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa02342-036c-432d-989b-bc5a514a262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:06.572116 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02342-036c-432d-989b-bc5a514a262e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:06.572390 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02342-036c-432d-989b-bc5a514a262e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:06.572661 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02342-036c-432d-989b-bc5a514a262e None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:06.573375 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa02342-036c-432d-989b-bc5a514a262e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:06.573674 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa02342-036c-432d-989b-bc5a514a262e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:06.575152 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa02342-036c-432d-989b-bc5a514a262e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:06.587185 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 536/1075] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:13:06.588262 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701af50d-309f-4646-b663-081c7635db4f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:06.600237 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 540/1076] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 07:13:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:06.601073 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa02342-036c-432d-989b-bc5a514a262e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:06.663882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:06.694333 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701af50d-309f-4646-b663-081c7635db4f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:06.698836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa02342-036c-432d-989b-bc5a514a262e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:06.727718 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c9f26-21e2-4a8e-98aa-dbd9e50954ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:06.728392 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c9f26-21e2-4a8e-98aa-dbd9e50954ba None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:06.728668 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c9f26-21e2-4a8e-98aa-dbd9e50954ba None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:06.728938 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c9f26-21e2-4a8e-98aa-dbd9e50954ba None admin] PATH_INFO: `/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe/users/7b7c93376ab140a5b27bb7eb39533a16/roles/afe88bc03d30494b89892587177c79de` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:06.730810 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c9f26-21e2-4a8e-98aa-dbd9e50954ba None admin] RBAC: Authorizing `identity:create_grant(project_id=48b8b4a6eef145c4af6cb976ae8187fe, user_id=7b7c93376ab140a5b27bb7eb39533a16, role_id=afe88bc03d30494b89892587177c79de)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:06.732407 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c9f26-21e2-4a8e-98aa-dbd9e50954ba None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:06.732892 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ab044-0de4-45f5-8200-9d8084a4a091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:06.733504 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab044-0de4-45f5-8200-9d8084a4a091 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:06.733778 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab044-0de4-45f5-8200-9d8084a4a091 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:06.734044 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ab044-0de4-45f5-8200-9d8084a4a091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:06.743809 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ab044-0de4-45f5-8200-9d8084a4a091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:06.745260 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ab044-0de4-45f5-8200-9d8084a4a091 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:06.752601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-d60ab044-0de4-45f5-8200-9d8084a4a091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:13:06.760279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:06.764144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:13:06.765078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:13:06.765078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:06.765078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:06.765078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 541/1077] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:06.765078 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ab044-0de4-45f5-8200-9d8084a4a091 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:06.777193 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 537/1078] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:13:06 2022] PUT /identity/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe/users/7b7c93376ab140a5b27bb7eb39533a16/roles/afe88bc03d30494b89892587177c79de => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:13:06.778023 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c9f26-21e2-4a8e-98aa-dbd9e50954ba None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:06.877034 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ab044-0de4-45f5-8200-9d8084a4a091 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:06.898922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c9f26-21e2-4a8e-98aa-dbd9e50954ba None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:06.913421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d0179-6d25-4b54-b1fc-b533f051363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:06.914058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d0179-6d25-4b54-b1fc-b533f051363a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:06.914363 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d0179-6d25-4b54-b1fc-b533f051363a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:06.914637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d0179-6d25-4b54-b1fc-b533f051363a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:06.931201 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d0179-6d25-4b54-b1fc-b533f051363a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:06.932659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d0179-6d25-4b54-b1fc-b533f051363a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:06.933227 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:06.940081 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5785c-0d08-4348-bfb5-92fec7cdd652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:06.940680 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5785c-0d08-4348-bfb5-92fec7cdd652 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:06.941004 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5785c-0d08-4348-bfb5-92fec7cdd652 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:06.941276 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5785c-0d08-4348-bfb5-92fec7cdd652 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:06.942038 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5785c-0d08-4348-bfb5-92fec7cdd652 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:06.949587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5785c-0d08-4348-bfb5-92fec7cdd652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:06.949587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5785c-0d08-4348-bfb5-92fec7cdd652 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ab0d0179-6d25-4b54-b1fc-b533f051363a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:13:06.949796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:06.951064 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:13:06.951940 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:13:06.951940 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:06.951940 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:06.951940 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 542/1079] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:06.955148 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d0179-6d25-4b54-b1fc-b533f051363a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:06.957697 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 538/1080] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:07.014142 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:07.068755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d0179-6d25-4b54-b1fc-b533f051363a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:07.107681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17366e38-6519-4c99-a342-1bbae3666d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:07.108386 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17366e38-6519-4c99-a342-1bbae3666d47 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:07.108671 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17366e38-6519-4c99-a342-1bbae3666d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:07.108942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17366e38-6519-4c99-a342-1bbae3666d47 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:07.109584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17366e38-6519-4c99-a342-1bbae3666d47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:07.109889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17366e38-6519-4c99-a342-1bbae3666d47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:07.111282 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17366e38-6519-4c99-a342-1bbae3666d47 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:07.124761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 543/1081] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:13:07.130476 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5785c-0d08-4348-bfb5-92fec7cdd652 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:07.239813 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5785c-0d08-4348-bfb5-92fec7cdd652 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:07.275689 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03d685-e43a-47e3-8a5c-468bfe951398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:07.276308 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d685-e43a-47e3-8a5c-468bfe951398 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:07.276580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d685-e43a-47e3-8a5c-468bfe951398 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:07.276846 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03d685-e43a-47e3-8a5c-468bfe951398 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:07.283376 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03d685-e43a-47e3-8a5c-468bfe951398 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:07.284798 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e03d685-e43a-47e3-8a5c-468bfe951398 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7e03d685-e43a-47e3-8a5c-468bfe951398 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:13:07.295687 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:07.296561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:07.297454 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:13:07.297454 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:13:07.297454 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:13:07.297454 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:13:07.297454 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:13:07.297454 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:13:07.297454 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:13:07.297454 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:13:07.297454 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 539/1082] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:07.302780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17366e38-6519-4c99-a342-1bbae3666d47 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:07.402469 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17366e38-6519-4c99-a342-1bbae3666d47 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:07.413735 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:07.437261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fef405-2bea-4d28-baab-6b252353c037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:07.437865 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef405-2bea-4d28-baab-6b252353c037 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:07.438178 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef405-2bea-4d28-baab-6b252353c037 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:07.438482 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef405-2bea-4d28-baab-6b252353c037 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:07.439197 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fef405-2bea-4d28-baab-6b252353c037 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:07.439495 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fef405-2bea-4d28-baab-6b252353c037 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:07.440907 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fef405-2bea-4d28-baab-6b252353c037 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:07.457080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 544/1083] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:07.458263 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03d685-e43a-47e3-8a5c-468bfe951398 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:07.507389 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:07.555600 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03d685-e43a-47e3-8a5c-468bfe951398 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:07.593045 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb29836-b61e-4b96-96de-b9b3b01971e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:07.593750 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29836-b61e-4b96-96de-b9b3b01971e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:07.594033 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29836-b61e-4b96-96de-b9b3b01971e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:07.594336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29836-b61e-4b96-96de-b9b3b01971e4 None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/bb99f54d9320496cbcc52d535fa64789/roles/07dc752249564549bf2144d8dc2d4ca1` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:07.598214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb29836-b61e-4b96-96de-b9b3b01971e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=bb99f54d9320496cbcc52d535fa64789, role_id=07dc752249564549bf2144d8dc2d4ca1)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:07.599646 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb29836-b61e-4b96-96de-b9b3b01971e4 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:07.658256 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 540/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:13:07 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/bb99f54d9320496cbcc52d535fa64789/roles/07dc752249564549bf2144d8dc2d4ca1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:13:08.703306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb91c92-4592-4273-92af-4c0a7c16362e None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:08.703884 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb91c92-4592-4273-92af-4c0a7c16362e None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:08.703884 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb91c92-4592-4273-92af-4c0a7c16362e None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:08.705239 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 545/1085] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:08.711200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228c7ba-b379-47b4-8224-16b753839d62 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:08.711750 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228c7ba-b379-47b4-8224-16b753839d62 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:08.711750 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228c7ba-b379-47b4-8224-16b753839d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:08.730497 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-f228c7ba-b379-47b4-8224-16b753839d62 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:08.732496 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-f228c7ba-b379-47b4-8224-16b753839d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:08.796829 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 541/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:09.063379 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb91c92-4592-4273-92af-4c0a7c16362e None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:09.164494 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb91c92-4592-4273-92af-4c0a7c16362e None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:09.197141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d25e1-1e31-4a71-b575-d382ffdb4feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:09.197761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d25e1-1e31-4a71-b575-d382ffdb4feb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:09.198038 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d25e1-1e31-4a71-b575-d382ffdb4feb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:09.198329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d25e1-1e31-4a71-b575-d382ffdb4feb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:09.208751 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d25e1-1e31-4a71-b575-d382ffdb4feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-cb2d25e1-1e31-4a71-b575-d382ffdb4feb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:09.213586 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:09.214628 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:09.216072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 546/1087] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:13:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:09.221496 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228c7ba-b379-47b4-8224-16b753839d62 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:09.261392 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:09.317629 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228c7ba-b379-47b4-8224-16b753839d62 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:09.351764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d41fc-3f97-48ac-b5b1-a5581870d7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:09.352359 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d41fc-3f97-48ac-b5b1-a5581870d7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:09.352635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d41fc-3f97-48ac-b5b1-a5581870d7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:09.352902 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d41fc-3f97-48ac-b5b1-a5581870d7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:09.353555 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d41fc-3f97-48ac-b5b1-a5581870d7a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:09.353852 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d41fc-3f97-48ac-b5b1-a5581870d7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:09.355244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d41fc-3f97-48ac-b5b1-a5581870d7a9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:09.363427 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 542/1088] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:13:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:09.369096 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d25e1-1e31-4a71-b575-d382ffdb4feb None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:09.400536 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:09.471316 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d25e1-1e31-4a71-b575-d382ffdb4feb None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:09.504689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067dfee-a68d-4a02-9690-c6043667ed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:09.505314 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067dfee-a68d-4a02-9690-c6043667ed39 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:09.505595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067dfee-a68d-4a02-9690-c6043667ed39 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:09.505868 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067dfee-a68d-4a02-9690-c6043667ed39 None admin] PATH_INFO: `/v3/users/7b7c93376ab140a5b27bb7eb39533a16` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:09.507012 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067dfee-a68d-4a02-9690-c6043667ed39 None admin] RBAC: Authorizing `identity:get_user(user_id=7b7c93376ab140a5b27bb7eb39533a16)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:09.508433 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7067dfee-a68d-4a02-9690-c6043667ed39 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:09.510270 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 547/1089] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:09 2022] GET /identity/v3/users/7b7c93376ab140a5b27bb7eb39533a16 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:13:09.516439 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d41fc-3f97-48ac-b5b1-a5581870d7a9 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:09.540748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdaa7e-2c74-4b83-ab7d-f2fdc0396743 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:09.541033 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdaa7e-2c74-4b83-ab7d-f2fdc0396743 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:09.541311 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdaa7e-2c74-4b83-ab7d-f2fdc0396743 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:09.542808 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 548/1090] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 07:13:09.547696 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710eaa0c-d7d4-43e1-aad0-656aa861d4f8 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:09.547982 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710eaa0c-d7d4-43e1-aad0-656aa861d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:09.548259 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710eaa0c-d7d4-43e1-aad0-656aa861d4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:09.566544 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-710eaa0c-d7d4-43e1-aad0-656aa861d4f8 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:09.567773 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-710eaa0c-d7d4-43e1-aad0-656aa861d4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:09.616534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d41fc-3f97-48ac-b5b1-a5581870d7a9 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:09.618080 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:09.635548 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 549/1091] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:13:09.651432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb2d97-b7c9-4dd3-9bfb-5eac0c86081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:09.652028 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb2d97-b7c9-4dd3-9bfb-5eac0c86081c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:09.652598 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb2d97-b7c9-4dd3-9bfb-5eac0c86081c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:09.652875 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb2d97-b7c9-4dd3-9bfb-5eac0c86081c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:09.719016 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb2d97-b7c9-4dd3-9bfb-5eac0c86081c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:09.720446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb2d97-b7c9-4dd3-9bfb-5eac0c86081c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:09.815580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 543/1092] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:13:09.821491 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710eaa0c-d7d4-43e1-aad0-656aa861d4f8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:09.849514 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:09.904445 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb2d97-b7c9-4dd3-9bfb-5eac0c86081c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:09.907060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:09.919475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710eaa0c-d7d4-43e1-aad0-656aa861d4f8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:09.953686 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9218ad-a2be-4747-964d-ebaad7018179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:09.954339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9218ad-a2be-4747-964d-ebaad7018179 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:09.954618 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9218ad-a2be-4747-964d-ebaad7018179 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:09.954891 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9218ad-a2be-4747-964d-ebaad7018179 None admin] PATH_INFO: `/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:09.955999 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9218ad-a2be-4747-964d-ebaad7018179 None admin] RBAC: Authorizing `identity:get_project(project_id=48b8b4a6eef145c4af6cb976ae8187fe)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:09.957419 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9218ad-a2be-4747-964d-ebaad7018179 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:09.959072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 550/1093] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:09 2022] GET /identity/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:09.965250 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9218ad-a2be-4747-964d-ebaad7018179 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:10.003667 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb2d97-b7c9-4dd3-9bfb-5eac0c86081c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:10.037320 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676375ed-bf19-4646-971d-2f77ebe0dd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:10.037934 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676375ed-bf19-4646-971d-2f77ebe0dd1e None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:10.038248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676375ed-bf19-4646-971d-2f77ebe0dd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:10.038519 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676375ed-bf19-4646-971d-2f77ebe0dd1e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:10.048884 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676375ed-bf19-4646-971d-2f77ebe0dd1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-676375ed-bf19-4646-971d-2f77ebe0dd1e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:10.053481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:10.054481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:13:10.055354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 544/1094] 10.222.0.16 () {56 vars in 1120 bytes} [Tue Aug 23 07:13:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:13:10.057955 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:10.060749 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676375ed-bf19-4646-971d-2f77ebe0dd1e None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:10.063615 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9218ad-a2be-4747-964d-ebaad7018179 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:10.098712 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b9b1-b206-43f1-8907-efdf40050024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:10.099256 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b9b1-b206-43f1-8907-efdf40050024 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:10.099530 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b9b1-b206-43f1-8907-efdf40050024 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:10.099793 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b9b1-b206-43f1-8907-efdf40050024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:10.100498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80b9b1-b206-43f1-8907-efdf40050024 None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=48b8b4a6eef145c4af6cb976ae8187fe, user.id=7b7c93376ab140a5b27bb7eb39533a16) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:10.100796 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80b9b1-b206-43f1-8907-efdf40050024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:10.102223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80b9b1-b206-43f1-8907-efdf40050024 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:10.108114 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 551/1095] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:13:09 2022] GET /identity/v3/role_assignments?user.id=7b7c93376ab140a5b27bb7eb39533a16&scope.project.id=48b8b4a6eef145c4af6cb976ae8187fe&role.id=afe88bc03d30494b89892587177c79de => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:13:10.123732 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:10.166819 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676375ed-bf19-4646-971d-2f77ebe0dd1e None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:10.203618 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37997886-f11c-47d2-8c44-4e91938fd235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:10.204233 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37997886-f11c-47d2-8c44-4e91938fd235 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:10.204512 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37997886-f11c-47d2-8c44-4e91938fd235 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:10.204793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37997886-f11c-47d2-8c44-4e91938fd235 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:10.205456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37997886-f11c-47d2-8c44-4e91938fd235 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:10.205764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37997886-f11c-47d2-8c44-4e91938fd235 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:10.207207 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37997886-f11c-47d2-8c44-4e91938fd235 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:10.216430 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 545/1096] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 07:13:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:13:10.222403 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b9b1-b206-43f1-8907-efdf40050024 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:10.323293 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b9b1-b206-43f1-8907-efdf40050024 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:10.356834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666140b-4b5e-4171-a60e-554afcc58574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:10.357392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666140b-4b5e-4171-a60e-554afcc58574 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:10.357671 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666140b-4b5e-4171-a60e-554afcc58574 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:10.357941 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666140b-4b5e-4171-a60e-554afcc58574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:10.368420 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666140b-4b5e-4171-a60e-554afcc58574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:10.369850 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0666140b-4b5e-4171-a60e-554afcc58574 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0666140b-4b5e-4171-a60e-554afcc58574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:13:10.384333 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:10.385362 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:13:10.386294 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:13:10.386294 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:10.386294 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:10.386294 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 552/1097] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:10.391868 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37997886-f11c-47d2-8c44-4e91938fd235 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:10.489368 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37997886-f11c-47d2-8c44-4e91938fd235 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:10.511683 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:10.522413 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00757808-affa-4ca1-b4c3-d8f9a803907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:10.523009 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757808-affa-4ca1-b4c3-d8f9a803907b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:10.523282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757808-affa-4ca1-b4c3-d8f9a803907b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:10.523565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00757808-affa-4ca1-b4c3-d8f9a803907b None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:10.524181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00757808-affa-4ca1-b4c3-d8f9a803907b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:10.525947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00757808-affa-4ca1-b4c3-d8f9a803907b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:10.525947 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00757808-affa-4ca1-b4c3-d8f9a803907b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:10.537502 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 546/1098] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:10.543239 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666140b-4b5e-4171-a60e-554afcc58574 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:10.558744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:10.643857 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666140b-4b5e-4171-a60e-554afcc58574 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:10.676873 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f836eaf-12ab-4643-a5de-588f4f5ddaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:10.677496 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f836eaf-12ab-4643-a5de-588f4f5ddaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:10.677771 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f836eaf-12ab-4643-a5de-588f4f5ddaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:10.678038 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f836eaf-12ab-4643-a5de-588f4f5ddaa1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:10.685542 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f836eaf-12ab-4643-a5de-588f4f5ddaa1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:10.686997 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f836eaf-12ab-4643-a5de-588f4f5ddaa1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-1f836eaf-12ab-4643-a5de-588f4f5ddaa1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:13:10.698058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:10.699035 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:10.699945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:10.699945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:10.699945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:13:10.699945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:13:10.699945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:13:10.699945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:13:10.699945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:13:10.699945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:13:10.699945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 07:13:10.699945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:10.699945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 553/1099] 10.222.0.16 () {56 vars in 1093 bytes} [Tue Aug 23 07:13:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:10.704950 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00757808-affa-4ca1-b4c3-d8f9a803907b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:10.802496 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00757808-affa-4ca1-b4c3-d8f9a803907b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:10.835955 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47955e9a-a016-4f39-9bfc-af56ee7fdccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:10.836535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47955e9a-a016-4f39-9bfc-af56ee7fdccb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:10.836811 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47955e9a-a016-4f39-9bfc-af56ee7fdccb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:10.837079 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47955e9a-a016-4f39-9bfc-af56ee7fdccb None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:10.838053 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47955e9a-a016-4f39-9bfc-af56ee7fdccb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:10.838377 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47955e9a-a016-4f39-9bfc-af56ee7fdccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:10.839783 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47955e9a-a016-4f39-9bfc-af56ee7fdccb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:10.856963 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 547/1100] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 23 07:13:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:10.862618 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f836eaf-12ab-4643-a5de-588f4f5ddaa1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:10.930220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:10.959514 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f836eaf-12ab-4643-a5de-588f4f5ddaa1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:10.992633 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a8bae-8516-422f-93b2-4da4b9285cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:10.993231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8bae-8516-422f-93b2-4da4b9285cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:10.993507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8bae-8516-422f-93b2-4da4b9285cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:10.993773 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8bae-8516-422f-93b2-4da4b9285cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:11.058348 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a8bae-8516-422f-93b2-4da4b9285cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:11.060405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a8bae-8516-422f-93b2-4da4b9285cf2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:11.126382 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:11.156129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 554/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 07:13:11.161967 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47955e9a-a016-4f39-9bfc-af56ee7fdccb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:11.205249 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:11.261831 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47955e9a-a016-4f39-9bfc-af56ee7fdccb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:11.295269 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1525d9-040f-45c3-a4de-6ac9999d0f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:11.295881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1525d9-040f-45c3-a4de-6ac9999d0f75 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:11.296161 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1525d9-040f-45c3-a4de-6ac9999d0f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:11.296429 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1525d9-040f-45c3-a4de-6ac9999d0f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:11.306181 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1525d9-040f-45c3-a4de-6ac9999d0f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:11.307613 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1525d9-040f-45c3-a4de-6ac9999d0f75 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-2b1525d9-040f-45c3-a4de-6ac9999d0f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:13:11.322378 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:11.323513 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:13:11.324876 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:13:11.324876 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:13:11.324876 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:13:11.324876 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 548/1102] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:11.329490 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a8bae-8516-422f-93b2-4da4b9285cf2 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:11.427388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a8bae-8516-422f-93b2-4da4b9285cf2 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:11.466811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19614473-dc44-46ea-95b9-c4249b6fe151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:11.467331 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19614473-dc44-46ea-95b9-c4249b6fe151 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:11.467611 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19614473-dc44-46ea-95b9-c4249b6fe151 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:11.467884 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19614473-dc44-46ea-95b9-c4249b6fe151 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:11.468522 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19614473-dc44-46ea-95b9-c4249b6fe151 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:11.468823 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19614473-dc44-46ea-95b9-c4249b6fe151 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:11.470208 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19614473-dc44-46ea-95b9-c4249b6fe151 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:11.481429 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 555/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:11.487170 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1525d9-040f-45c3-a4de-6ac9999d0f75 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:11.579043 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:11.588036 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1525d9-040f-45c3-a4de-6ac9999d0f75 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:11.622401 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44d71a-7bbe-4f21-bea8-1f2d6cb3efea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:11.623018 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d71a-7bbe-4f21-bea8-1f2d6cb3efea None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:11.623298 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d71a-7bbe-4f21-bea8-1f2d6cb3efea None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:11.623569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44d71a-7bbe-4f21-bea8-1f2d6cb3efea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:11.630406 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44d71a-7bbe-4f21-bea8-1f2d6cb3efea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:11.632198 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd44d71a-7bbe-4f21-bea8-1f2d6cb3efea None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-bd44d71a-7bbe-4f21-bea8-1f2d6cb3efea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:13:11.643857 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:11.644738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:11.645617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:13:11.645617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:13:11.645617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:13:11.645617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:13:11.645617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:13:11.645617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:13:11.645617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:13:11.645617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:13:11.645617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 549/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 07:13:11.650885 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19614473-dc44-46ea-95b9-c4249b6fe151 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:11.682709 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:11.752298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19614473-dc44-46ea-95b9-c4249b6fe151 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:11.785724 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec0c38-d5c7-4dcb-b366-d4d9cf38b567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:11.786354 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0c38-d5c7-4dcb-b366-d4d9cf38b567 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:11.786637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0c38-d5c7-4dcb-b366-d4d9cf38b567 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:11.786910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec0c38-d5c7-4dcb-b366-d4d9cf38b567 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:11.787596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec0c38-d5c7-4dcb-b366-d4d9cf38b567 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:11.787900 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec0c38-d5c7-4dcb-b366-d4d9cf38b567 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:11.789322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec0c38-d5c7-4dcb-b366-d4d9cf38b567 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:11.801147 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 556/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:13:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:11.807302 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44d71a-7bbe-4f21-bea8-1f2d6cb3efea None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:11.911245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd44d71a-7bbe-4f21-bea8-1f2d6cb3efea None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:11.944718 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0efb0-41a0-41dd-bb60-582c6da884b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:11.945308 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0efb0-41a0-41dd-bb60-582c6da884b9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:11.945589 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0efb0-41a0-41dd-bb60-582c6da884b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:11.945861 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0efb0-41a0-41dd-bb60-582c6da884b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:11.946617 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0efb0-41a0-41dd-bb60-582c6da884b9 None admin] RBAC: Adding query filter params (role.id=07dc752249564549bf2144d8dc2d4ca1, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=bb99f54d9320496cbcc52d535fa64789) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:11.946921 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0efb0-41a0-41dd-bb60-582c6da884b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:11.948335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0efb0-41a0-41dd-bb60-582c6da884b9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:11.954660 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 550/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:13:11 2022] GET /identity/v3/role_assignments?user.id=bb99f54d9320496cbcc52d535fa64789&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=07dc752249564549bf2144d8dc2d4ca1 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:12.048167 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c135f4-cbb7-49b8-886e-64094585c4a8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:12.048698 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c135f4-cbb7-49b8-886e-64094585c4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:12.048698 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c135f4-cbb7-49b8-886e-64094585c4a8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:12.050207 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 557/1107] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:12.055984 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab81485-6df0-4a92-b503-9834fa21c873 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:12.056270 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab81485-6df0-4a92-b503-9834fa21c873 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:12.056542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab81485-6df0-4a92-b503-9834fa21c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:12.075823 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8ab81485-6df0-4a92-b503-9834fa21c873 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:12.077131 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8ab81485-6df0-4a92-b503-9834fa21c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:12.092464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:12.149541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 551/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:12.419594 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c135f4-cbb7-49b8-886e-64094585c4a8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:12.516671 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:12.526432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c135f4-cbb7-49b8-886e-64094585c4a8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:12.560901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec009c8a-e78e-49d7-a4cf-f58001bb8f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:12.561535 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009c8a-e78e-49d7-a4cf-f58001bb8f6f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:12.561815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009c8a-e78e-49d7-a4cf-f58001bb8f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:12.562091 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec009c8a-e78e-49d7-a4cf-f58001bb8f6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:12.563228 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec009c8a-e78e-49d7-a4cf-f58001bb8f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:12.564689 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec009c8a-e78e-49d7-a4cf-f58001bb8f6f None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:12.566286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 558/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:12.572388 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab81485-6df0-4a92-b503-9834fa21c873 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:12.676264 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab81485-6df0-4a92-b503-9834fa21c873 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:12.710717 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbd808-13bb-418b-b236-776328dadfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:12.711310 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbd808-13bb-418b-b236-776328dadfdb None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:12.711584 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbd808-13bb-418b-b236-776328dadfdb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:12.711848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbd808-13bb-418b-b236-776328dadfdb None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:12.712753 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbd808-13bb-418b-b236-776328dadfdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:12.714184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbd808-13bb-418b-b236-776328dadfdb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:12.795315 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 552/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:13:12 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:13:14.729601 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a56be-c487-4d32-bff4-99fc1e27c468 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:14.730150 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a56be-c487-4d32-bff4-99fc1e27c468 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:14.730150 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a56be-c487-4d32-bff4-99fc1e27c468 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:14.732342 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 559/1111] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:14.737512 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cd46f-7330-4150-b907-149dd8c5c4ad None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:14.737933 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cd46f-7330-4150-b907-149dd8c5c4ad None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:14.738067 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1cd46f-7330-4150-b907-149dd8c5c4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:14.745366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:14.755797 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-4f1cd46f-7330-4150-b907-149dd8c5c4ad None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:14.757001 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-4f1cd46f-7330-4150-b907-149dd8c5c4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:14.822881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 553/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:15.091996 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a56be-c487-4d32-bff4-99fc1e27c468 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:15.190436 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a56be-c487-4d32-bff4-99fc1e27c468 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:15.224508 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437fbff-4af1-4ddf-94fd-904811c44b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:15.225121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437fbff-4af1-4ddf-94fd-904811c44b40 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:15.225397 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437fbff-4af1-4ddf-94fd-904811c44b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:15.225666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437fbff-4af1-4ddf-94fd-904811c44b40 None admin] PATH_INFO: `/v3/roles/adc491d8d49c47779e572883af3ed47e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:15.227048 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437fbff-4af1-4ddf-94fd-904811c44b40 None admin] RBAC: Authorizing `identity:get_role(role_id=adc491d8d49c47779e572883af3ed47e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:15.228396 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437fbff-4af1-4ddf-94fd-904811c44b40 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:15.229679 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 560/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:15 2022] GET /identity/v3/roles/adc491d8d49c47779e572883af3ed47e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:15.235595 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cd46f-7330-4150-b907-149dd8c5c4ad None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:15.330340 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1cd46f-7330-4150-b907-149dd8c5c4ad None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:15.363360 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c43736-8e6c-43de-b000-26b6b2982218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:15.363909 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c43736-8e6c-43de-b000-26b6b2982218 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:15.364185 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c43736-8e6c-43de-b000-26b6b2982218 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:15.364452 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c43736-8e6c-43de-b000-26b6b2982218 None admin] PATH_INFO: `/v3/users/1fc046e269834738bce2717d5ec5dde9` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:15.366316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:15.377362 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c43736-8e6c-43de-b000-26b6b2982218 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc046e269834738bce2717d5ec5dde9)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:15.378833 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c43736-8e6c-43de-b000-26b6b2982218 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:15.380389 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 554/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:15 2022] GET /identity/v3/users/1fc046e269834738bce2717d5ec5dde9 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:15.385938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437fbff-4af1-4ddf-94fd-904811c44b40 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:15.414243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:15.484044 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437fbff-4af1-4ddf-94fd-904811c44b40 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:15.517374 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861d9a0-9578-42b6-89a7-bf511648de5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:15.517962 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861d9a0-9578-42b6-89a7-bf511648de5a None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:15.518267 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861d9a0-9578-42b6-89a7-bf511648de5a None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:15.518536 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861d9a0-9578-42b6-89a7-bf511648de5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:15.583564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861d9a0-9578-42b6-89a7-bf511648de5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:15.585451 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861d9a0-9578-42b6-89a7-bf511648de5a None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:15.611334 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:15.679535 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 561/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:13:15.685969 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c43736-8e6c-43de-b000-26b6b2982218 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:15.781809 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c43736-8e6c-43de-b000-26b6b2982218 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:15.815041 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca78f8-71fc-4dfc-8acc-118b9075a14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:15.815648 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca78f8-71fc-4dfc-8acc-118b9075a14d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:15.815926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca78f8-71fc-4dfc-8acc-118b9075a14d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:15.816193 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca78f8-71fc-4dfc-8acc-118b9075a14d None admin] PATH_INFO: `/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:15.817289 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca78f8-71fc-4dfc-8acc-118b9075a14d None admin] RBAC: Authorizing `identity:get_project(project_id=48b8b4a6eef145c4af6cb976ae8187fe)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:15.818731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca78f8-71fc-4dfc-8acc-118b9075a14d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:15.820329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 555/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:15 2022] GET /identity/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:15.826564 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861d9a0-9578-42b6-89a7-bf511648de5a None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:15.922414 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861d9a0-9578-42b6-89a7-bf511648de5a None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:15.947332 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:15.954774 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93373dd4-9477-445b-8394-d76c86ae3195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:15.955359 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93373dd4-9477-445b-8394-d76c86ae3195 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:15.955630 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93373dd4-9477-445b-8394-d76c86ae3195 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:15.956454 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93373dd4-9477-445b-8394-d76c86ae3195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:15.956584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93373dd4-9477-445b-8394-d76c86ae3195 None admin] RBAC: Adding query filter params (role.id=adc491d8d49c47779e572883af3ed47e, scope.project.id=48b8b4a6eef145c4af6cb976ae8187fe, user.id=1fc046e269834738bce2717d5ec5dde9) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:15.956881 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93373dd4-9477-445b-8394-d76c86ae3195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:15.958304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93373dd4-9477-445b-8394-d76c86ae3195 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:15.963764 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 562/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:13:15 2022] GET /identity/v3/role_assignments?user.id=1fc046e269834738bce2717d5ec5dde9&scope.project.id=48b8b4a6eef145c4af6cb976ae8187fe&role.id=adc491d8d49c47779e572883af3ed47e => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:17.839016 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd976b5-060e-4f9b-be0d-4e053bd67f99 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:17.839561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd976b5-060e-4f9b-be0d-4e053bd67f99 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:17.839561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd976b5-060e-4f9b-be0d-4e053bd67f99 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:17.841482 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 556/1118] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:17.846785 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885ce5e-8cab-43b4-8e14-36b6bfc2dfb5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:17.847170 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885ce5e-8cab-43b4-8e14-36b6bfc2dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:17.847339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885ce5e-8cab-43b4-8e14-36b6bfc2dfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:17.865395 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-9885ce5e-8cab-43b4-8e14-36b6bfc2dfb5 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:17.866593 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-9885ce5e-8cab-43b4-8e14-36b6bfc2dfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:17.931312 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 563/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:18.193907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd976b5-060e-4f9b-be0d-4e053bd67f99 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:18.252927 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:18.293319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd976b5-060e-4f9b-be0d-4e053bd67f99 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:18.327059 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27585f3-97f8-429e-8ddc-354be6c998e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:18.327663 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27585f3-97f8-429e-8ddc-354be6c998e5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:18.327940 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27585f3-97f8-429e-8ddc-354be6c998e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:18.328207 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27585f3-97f8-429e-8ddc-354be6c998e5 None admin] PATH_INFO: `/v3/roles/adc491d8d49c47779e572883af3ed47e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:18.329580 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27585f3-97f8-429e-8ddc-354be6c998e5 None admin] RBAC: Authorizing `identity:get_role(role_id=adc491d8d49c47779e572883af3ed47e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:18.330964 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27585f3-97f8-429e-8ddc-354be6c998e5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:18.332252 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 557/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:18 2022] GET /identity/v3/roles/adc491d8d49c47779e572883af3ed47e => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:18.338216 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885ce5e-8cab-43b4-8e14-36b6bfc2dfb5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:18.432685 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885ce5e-8cab-43b4-8e14-36b6bfc2dfb5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:18.455354 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:18.466702 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058f8c9-d653-4002-ab0a-a73f2dd40573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:18.467317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f8c9-d653-4002-ab0a-a73f2dd40573 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:18.467591 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f8c9-d653-4002-ab0a-a73f2dd40573 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:18.467860 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058f8c9-d653-4002-ab0a-a73f2dd40573 None admin] PATH_INFO: `/v3/users/1fc046e269834738bce2717d5ec5dde9` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:18.468946 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058f8c9-d653-4002-ab0a-a73f2dd40573 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc046e269834738bce2717d5ec5dde9)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:18.470400 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058f8c9-d653-4002-ab0a-a73f2dd40573 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:18.471948 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 564/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:18 2022] GET /identity/v3/users/1fc046e269834738bce2717d5ec5dde9 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:18.477906 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27585f3-97f8-429e-8ddc-354be6c998e5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:18.574823 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27585f3-97f8-429e-8ddc-354be6c998e5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:18.601664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:18.609334 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2322d18-ca4f-47aa-b8c2-56bb9c4b0a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:18.614303 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2322d18-ca4f-47aa-b8c2-56bb9c4b0a30 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:18.614303 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2322d18-ca4f-47aa-b8c2-56bb9c4b0a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:18.614303 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2322d18-ca4f-47aa-b8c2-56bb9c4b0a30 None admin] PATH_INFO: `/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:18.614303 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2322d18-ca4f-47aa-b8c2-56bb9c4b0a30 None admin] RBAC: Authorizing `identity:get_project(project_id=48b8b4a6eef145c4af6cb976ae8187fe)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:18.614303 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2322d18-ca4f-47aa-b8c2-56bb9c4b0a30 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:18.614720 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 558/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:18 2022] GET /identity/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:18.620486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058f8c9-d653-4002-ab0a-a73f2dd40573 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:18.719410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058f8c9-d653-4002-ab0a-a73f2dd40573 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:18.751764 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6198ce0-f1e0-4bd6-8d45-21896060a297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:18.752395 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198ce0-f1e0-4bd6-8d45-21896060a297 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:18.752668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198ce0-f1e0-4bd6-8d45-21896060a297 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:18.752935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6198ce0-f1e0-4bd6-8d45-21896060a297 None admin] PATH_INFO: `/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe/users/1fc046e269834738bce2717d5ec5dde9/roles/adc491d8d49c47779e572883af3ed47e` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:18.755038 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6198ce0-f1e0-4bd6-8d45-21896060a297 None admin] RBAC: Authorizing `identity:create_grant(project_id=48b8b4a6eef145c4af6cb976ae8187fe, user_id=1fc046e269834738bce2717d5ec5dde9, role_id=adc491d8d49c47779e572883af3ed47e)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:18.756438 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6198ce0-f1e0-4bd6-8d45-21896060a297 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:18.822160 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 565/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:13:18 2022] PUT /identity/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe/users/1fc046e269834738bce2717d5ec5dde9/roles/adc491d8d49c47779e572883af3ed47e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:13:20.690833 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a120224-2c5f-48c0-b00c-6a9fcd9674de None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:20.691373 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a120224-2c5f-48c0-b00c-6a9fcd9674de None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:20.691373 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a120224-2c5f-48c0-b00c-6a9fcd9674de None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:20.692688 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 559/1124] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:20.697936 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9d459-869d-44a3-9356-ddaf452e56c9 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:20.698345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9d459-869d-44a3-9356-ddaf452e56c9 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:20.698519 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9d459-869d-44a3-9356-ddaf452e56c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:20.717381 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-3dd9d459-869d-44a3-9356-ddaf452e56c9 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:20.718595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-3dd9d459-869d-44a3-9356-ddaf452e56c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:20.762994 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:20.783228 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 566/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:21.050973 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a120224-2c5f-48c0-b00c-6a9fcd9674de None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:21.148868 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a120224-2c5f-48c0-b00c-6a9fcd9674de None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:21.181493 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554bbd3-9c2d-448b-927b-1945a11520e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:21.182090 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554bbd3-9c2d-448b-927b-1945a11520e0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:21.182390 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554bbd3-9c2d-448b-927b-1945a11520e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:21.182653 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554bbd3-9c2d-448b-927b-1945a11520e0 None admin] PATH_INFO: `/v3/roles/adc491d8d49c47779e572883af3ed47e` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:21.184184 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554bbd3-9c2d-448b-927b-1945a11520e0 None admin] RBAC: Authorizing `identity:get_role(role_id=adc491d8d49c47779e572883af3ed47e)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:21.185519 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554bbd3-9c2d-448b-927b-1945a11520e0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:21.186830 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 560/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:21 2022] GET /identity/v3/roles/adc491d8d49c47779e572883af3ed47e => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:21.192653 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9d459-869d-44a3-9356-ddaf452e56c9 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:21.289165 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9d459-869d-44a3-9356-ddaf452e56c9 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:21.321693 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e45aa-26f5-4fb4-ab74-fe557d056162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:21.322282 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e45aa-26f5-4fb4-ab74-fe557d056162 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:21.322565 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e45aa-26f5-4fb4-ab74-fe557d056162 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:21.322839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e45aa-26f5-4fb4-ab74-fe557d056162 None admin] PATH_INFO: `/v3/users/1fc046e269834738bce2717d5ec5dde9` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:21.324461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e45aa-26f5-4fb4-ab74-fe557d056162 None admin] RBAC: Authorizing `identity:get_user(user_id=1fc046e269834738bce2717d5ec5dde9)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:21.326210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e45aa-26f5-4fb4-ab74-fe557d056162 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:21.327755 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 567/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:21 2022] GET /identity/v3/users/1fc046e269834738bce2717d5ec5dde9 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:21.333346 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554bbd3-9c2d-448b-927b-1945a11520e0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:21.393725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:21.431823 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554bbd3-9c2d-448b-927b-1945a11520e0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:21.465802 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaddc03-4689-4ae3-a56e-f00214bf5b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:21.466486 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaddc03-4689-4ae3-a56e-f00214bf5b48 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:21.466744 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaddc03-4689-4ae3-a56e-f00214bf5b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:21.467017 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaddc03-4689-4ae3-a56e-f00214bf5b48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:21.531412 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaddc03-4689-4ae3-a56e-f00214bf5b48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:21.532848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaddc03-4689-4ae3-a56e-f00214bf5b48 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:21.590611 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:21.628709 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 561/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:13:21.634286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e45aa-26f5-4fb4-ab74-fe557d056162 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:21.682323 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:21.732888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e45aa-26f5-4fb4-ab74-fe557d056162 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:21.766028 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c796ad-9040-449e-b0b3-581c80fe664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:21.766671 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c796ad-9040-449e-b0b3-581c80fe664e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:21.766952 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c796ad-9040-449e-b0b3-581c80fe664e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:21.767225 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c796ad-9040-449e-b0b3-581c80fe664e None admin] PATH_INFO: `/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:21.768322 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c796ad-9040-449e-b0b3-581c80fe664e None admin] RBAC: Authorizing `identity:get_project(project_id=48b8b4a6eef145c4af6cb976ae8187fe)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:21.769738 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c796ad-9040-449e-b0b3-581c80fe664e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:21.771374 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 568/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:21 2022] GET /identity/v3/projects/48b8b4a6eef145c4af6cb976ae8187fe => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:21.777535 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaddc03-4689-4ae3-a56e-f00214bf5b48 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:21.873359 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaddc03-4689-4ae3-a56e-f00214bf5b48 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:21.905874 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc5813-b114-4bf6-9b4e-588305ecd4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:21.906489 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5813-b114-4bf6-9b4e-588305ecd4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:21.906768 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5813-b114-4bf6-9b4e-588305ecd4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:21.907039 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc5813-b114-4bf6-9b4e-588305ecd4c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:21.907751 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc5813-b114-4bf6-9b4e-588305ecd4c9 None admin] RBAC: Adding query filter params (role.id=adc491d8d49c47779e572883af3ed47e, scope.project.id=48b8b4a6eef145c4af6cb976ae8187fe, user.id=1fc046e269834738bce2717d5ec5dde9) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:21.908056 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc5813-b114-4bf6-9b4e-588305ecd4c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:21.909479 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc5813-b114-4bf6-9b4e-588305ecd4c9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:21.915111 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 562/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:13:21 2022] GET /identity/v3/role_assignments?user.id=1fc046e269834738bce2717d5ec5dde9&scope.project.id=48b8b4a6eef145c4af6cb976ae8187fe&role.id=adc491d8d49c47779e572883af3ed47e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:23.859936 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779a928-2daf-482f-888d-660c8cd005ac None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:23.860457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779a928-2daf-482f-888d-660c8cd005ac None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:23.860457 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779a928-2daf-482f-888d-660c8cd005ac None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:23.861745 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 569/1131] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:23.867034 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920b764-24e8-475a-8b91-cf345c7399c4 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:23.867532 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920b764-24e8-475a-8b91-cf345c7399c4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:23.867676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920b764-24e8-475a-8b91-cf345c7399c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:23.887193 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-8920b764-24e8-475a-8b91-cf345c7399c4 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:23.888373 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-8920b764-24e8-475a-8b91-cf345c7399c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:23.913520 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:23.961623 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 563/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:24.266556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779a928-2daf-482f-888d-660c8cd005ac None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:24.366083 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779a928-2daf-482f-888d-660c8cd005ac None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:24.382014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:24.399750 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e61fc-ffa0-461f-951d-c9b2412d6d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:24.402742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e61fc-ffa0-461f-951d-c9b2412d6d3d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:24.402742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e61fc-ffa0-461f-951d-c9b2412d6d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:24.402742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e61fc-ffa0-461f-951d-c9b2412d6d3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:24.402742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e61fc-ffa0-461f-951d-c9b2412d6d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:24.404104 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e61fc-ffa0-461f-951d-c9b2412d6d3d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:24.405659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 570/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:24.411548 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920b764-24e8-475a-8b91-cf345c7399c4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:24.507650 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920b764-24e8-475a-8b91-cf345c7399c4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:24.540838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18edc21-3340-4ae1-b73a-066b7d352e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:24.541359 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18edc21-3340-4ae1-b73a-066b7d352e80 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:24.541633 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18edc21-3340-4ae1-b73a-066b7d352e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:24.541903 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18edc21-3340-4ae1-b73a-066b7d352e80 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:24.542625 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18edc21-3340-4ae1-b73a-066b7d352e80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:24.544038 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18edc21-3340-4ae1-b73a-066b7d352e80 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:24.623372 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 564/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:13:24 2022] POST /identity/v3/projects => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:13:26.541284 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10194fc-420c-4c2f-80b5-96ec1c18172d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:26.541843 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10194fc-420c-4c2f-80b5-96ec1c18172d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:26.541843 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10194fc-420c-4c2f-80b5-96ec1c18172d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:26.543187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 571/1135] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:26.549063 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b354b-06ac-4f18-806d-ccb87396c7be None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:26.549473 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b354b-06ac-4f18-806d-ccb87396c7be None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:26.549615 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b354b-06ac-4f18-806d-ccb87396c7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:26.567955 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d54b354b-06ac-4f18-806d-ccb87396c7be None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:26.569120 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d54b354b-06ac-4f18-806d-ccb87396c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:26.571843 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:26.635572 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 565/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:26.900317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10194fc-420c-4c2f-80b5-96ec1c18172d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:27.001127 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10194fc-420c-4c2f-80b5-96ec1c18172d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:27.035432 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd6be8-b3ed-4bc7-8903-13a9d5fe2313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:27.036048 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6be8-b3ed-4bc7-8903-13a9d5fe2313 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:27.036329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6be8-b3ed-4bc7-8903-13a9d5fe2313 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:27.036602 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd6be8-b3ed-4bc7-8903-13a9d5fe2313 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:27.037680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd6be8-b3ed-4bc7-8903-13a9d5fe2313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:27.039130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd6be8-b3ed-4bc7-8903-13a9d5fe2313 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:27.040659 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 572/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:13:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:27.046376 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b354b-06ac-4f18-806d-ccb87396c7be None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:27.145703 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b354b-06ac-4f18-806d-ccb87396c7be None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:27.179568 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f29c18-e7e6-4400-963b-80687f9e997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:27.180092 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29c18-e7e6-4400-963b-80687f9e997f None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:27.180372 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29c18-e7e6-4400-963b-80687f9e997f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:27.180643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f29c18-e7e6-4400-963b-80687f9e997f None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:27.181281 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f29c18-e7e6-4400-963b-80687f9e997f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:27.182730 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f29c18-e7e6-4400-963b-80687f9e997f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:27.193311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:27.330783 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 566/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:13:27 2022] POST /identity/v3/users => generated 286 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:13:29.244971 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dcdc9-416d-40ed-b2ca-22c34e8d1b15 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:29.245505 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dcdc9-416d-40ed-b2ca-22c34e8d1b15 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:29.245505 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dcdc9-416d-40ed-b2ca-22c34e8d1b15 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:29.246943 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 573/1139] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:29.252115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1051a-cbd4-423c-9d72-d8d521f33878 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:29.252557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1051a-cbd4-423c-9d72-d8d521f33878 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:29.252652 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1051a-cbd4-423c-9d72-d8d521f33878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:29.270750 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-31d1051a-cbd4-423c-9d72-d8d521f33878 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:29.271927 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-31d1051a-cbd4-423c-9d72-d8d521f33878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:29.335634 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 567/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:29.608744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dcdc9-416d-40ed-b2ca-22c34e8d1b15 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:29.661226 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:29.706700 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dcdc9-416d-40ed-b2ca-22c34e8d1b15 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:29.740180 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc64295-4898-4b5d-a6b4-9d870937a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:29.740790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc64295-4898-4b5d-a6b4-9d870937a00f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:29.741072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc64295-4898-4b5d-a6b4-9d870937a00f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:29.741344 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc64295-4898-4b5d-a6b4-9d870937a00f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:29.751856 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc64295-4898-4b5d-a6b4-9d870937a00f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-efc64295-4898-4b5d-a6b4-9d870937a00f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:29.756539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:29.757711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:29.758733 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 574/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:29.763655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1051a-cbd4-423c-9d72-d8d521f33878 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:29.860296 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1051a-cbd4-423c-9d72-d8d521f33878 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:29.884822 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:29.893287 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863d461-0f71-4059-a9fd-827a9be4d6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:29.901775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d461-0f71-4059-a9fd-827a9be4d6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:29.901775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d461-0f71-4059-a9fd-827a9be4d6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:29.901775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863d461-0f71-4059-a9fd-827a9be4d6b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:29.901775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863d461-0f71-4059-a9fd-827a9be4d6b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:29.901775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863d461-0f71-4059-a9fd-827a9be4d6b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:29.901775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863d461-0f71-4059-a9fd-827a9be4d6b0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:29.905088 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 568/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:13:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:29.910747 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc64295-4898-4b5d-a6b4-9d870937a00f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:30.040288 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc64295-4898-4b5d-a6b4-9d870937a00f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:30.053679 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:30.074029 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c88b33-ba3a-4801-bb52-3b5e7187d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:30.075326 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88b33-ba3a-4801-bb52-3b5e7187d172 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:30.075825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88b33-ba3a-4801-bb52-3b5e7187d172 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:30.076154 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88b33-ba3a-4801-bb52-3b5e7187d172 None admin] PATH_INFO: `/v3/users/c6e0ed33897c44b4b5e78b8b90bc44ac` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:30.090748 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c88b33-ba3a-4801-bb52-3b5e7187d172 None admin] RBAC: Authorizing `identity:get_user(user_id=c6e0ed33897c44b4b5e78b8b90bc44ac)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:30.092559 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c88b33-ba3a-4801-bb52-3b5e7187d172 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:30.094188 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 575/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:29 2022] GET /identity/v3/users/c6e0ed33897c44b4b5e78b8b90bc44ac => generated 286 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:30.100134 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863d461-0f71-4059-a9fd-827a9be4d6b0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:30.202717 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863d461-0f71-4059-a9fd-827a9be4d6b0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:30.236244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01989c-b909-4bc2-9b72-12994f172ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:30.236835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01989c-b909-4bc2-9b72-12994f172ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:30.237116 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01989c-b909-4bc2-9b72-12994f172ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:30.237385 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01989c-b909-4bc2-9b72-12994f172ad0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:30.290348 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:30.302309 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01989c-b909-4bc2-9b72-12994f172ad0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:30.303745 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01989c-b909-4bc2-9b72-12994f172ad0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:30.398959 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 569/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:13:30.405681 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c88b33-ba3a-4801-bb52-3b5e7187d172 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:30.501888 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c88b33-ba3a-4801-bb52-3b5e7187d172 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:30.535066 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35a784-b8e8-4e0a-b9ec-535ecca10144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:30.535670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a784-b8e8-4e0a-b9ec-535ecca10144 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:30.535945 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a784-b8e8-4e0a-b9ec-535ecca10144 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:30.536210 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a784-b8e8-4e0a-b9ec-535ecca10144 None admin] PATH_INFO: `/v3/projects/fc152608794d43d08aff4d1db2a3c042` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:30.537286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35a784-b8e8-4e0a-b9ec-535ecca10144 None admin] RBAC: Authorizing `identity:get_project(project_id=fc152608794d43d08aff4d1db2a3c042)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:30.538747 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35a784-b8e8-4e0a-b9ec-535ecca10144 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:30.540353 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 576/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:30 2022] GET /identity/v3/projects/fc152608794d43d08aff4d1db2a3c042 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:30.546365 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01989c-b909-4bc2-9b72-12994f172ad0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:30.633499 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:30.645359 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01989c-b909-4bc2-9b72-12994f172ad0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:30.678214 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b03eb-6189-450f-8f56-a2f078d9156a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:30.678807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b03eb-6189-450f-8f56-a2f078d9156a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:30.679088 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b03eb-6189-450f-8f56-a2f078d9156a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:30.679356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b03eb-6189-450f-8f56-a2f078d9156a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:30.680070 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b03eb-6189-450f-8f56-a2f078d9156a None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=fc152608794d43d08aff4d1db2a3c042, user.id=c6e0ed33897c44b4b5e78b8b90bc44ac) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:30.680376 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b03eb-6189-450f-8f56-a2f078d9156a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:30.681805 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b03eb-6189-450f-8f56-a2f078d9156a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:30.687913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 570/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:13:30 2022] GET /identity/v3/role_assignments?user.id=c6e0ed33897c44b4b5e78b8b90bc44ac&scope.project.id=fc152608794d43d08aff4d1db2a3c042&role.id=afe88bc03d30494b89892587177c79de => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:32.559816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7f8ef-f5a2-490f-868d-81c81e2572c1 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:32.560341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7f8ef-f5a2-490f-868d-81c81e2572c1 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:32.560341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7f8ef-f5a2-490f-868d-81c81e2572c1 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:32.561700 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 577/1147] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:32.566742 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce753f-5736-42d0-a845-d7432b9b327d None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:32.567151 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce753f-5736-42d0-a845-d7432b9b327d None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:32.567293 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce753f-5736-42d0-a845-d7432b9b327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:32.585275 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-48ce753f-5736-42d0-a845-d7432b9b327d None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:32.586534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-48ce753f-5736-42d0-a845-d7432b9b327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:32.651574 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 571/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:32.921088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7f8ef-f5a2-490f-868d-81c81e2572c1 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:32.961858 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:33.020461 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7f8ef-f5a2-490f-868d-81c81e2572c1 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:33.052790 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e4807-77b2-434e-8c6c-10d1c3635986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:33.053394 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e4807-77b2-434e-8c6c-10d1c3635986 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:33.053670 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e4807-77b2-434e-8c6c-10d1c3635986 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:33.053938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e4807-77b2-434e-8c6c-10d1c3635986 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:33.063867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e4807-77b2-434e-8c6c-10d1c3635986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0c5e4807-77b2-434e-8c6c-10d1c3635986 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:33.068427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:33.069507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:33.070410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 578/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:13:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:33.076044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce753f-5736-42d0-a845-d7432b9b327d None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:33.154162 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:33.171271 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce753f-5736-42d0-a845-d7432b9b327d None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:33.204494 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb0d60-fa22-49f2-85d2-74ae2c6d6a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:33.205083 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb0d60-fa22-49f2-85d2-74ae2c6d6a78 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:33.205357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb0d60-fa22-49f2-85d2-74ae2c6d6a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:33.205618 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb0d60-fa22-49f2-85d2-74ae2c6d6a78 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:33.206290 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb0d60-fa22-49f2-85d2-74ae2c6d6a78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:33.206587 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb0d60-fa22-49f2-85d2-74ae2c6d6a78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:33.207917 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb0d60-fa22-49f2-85d2-74ae2c6d6a78 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:33.216699 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 572/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:13:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:33.222390 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e4807-77b2-434e-8c6c-10d1c3635986 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:33.316179 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:33.319863 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e4807-77b2-434e-8c6c-10d1c3635986 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:33.352814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274130ba-a48e-4034-9fc9-2fca2a26b495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:33.353429 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274130ba-a48e-4034-9fc9-2fca2a26b495 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:33.353709 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274130ba-a48e-4034-9fc9-2fca2a26b495 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:33.353983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274130ba-a48e-4034-9fc9-2fca2a26b495 None admin] PATH_INFO: `/v3/users/c6e0ed33897c44b4b5e78b8b90bc44ac` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:33.355108 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274130ba-a48e-4034-9fc9-2fca2a26b495 None admin] RBAC: Authorizing `identity:get_user(user_id=c6e0ed33897c44b4b5e78b8b90bc44ac)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:33.357211 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274130ba-a48e-4034-9fc9-2fca2a26b495 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:33.358801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 579/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:33 2022] GET /identity/v3/users/c6e0ed33897c44b4b5e78b8b90bc44ac => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:33.364465 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb0d60-fa22-49f2-85d2-74ae2c6d6a78 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:33.462499 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb0d60-fa22-49f2-85d2-74ae2c6d6a78 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:33.495386 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33f94a-52ab-4d31-a59a-dbb53d6e66b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:33.495989 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f94a-52ab-4d31-a59a-dbb53d6e66b9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:33.496466 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f94a-52ab-4d31-a59a-dbb53d6e66b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:33.496816 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33f94a-52ab-4d31-a59a-dbb53d6e66b9 None admin] PATH_INFO: `/v3/projects/fc152608794d43d08aff4d1db2a3c042` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:33.497907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33f94a-52ab-4d31-a59a-dbb53d6e66b9 None admin] RBAC: Authorizing `identity:get_project(project_id=fc152608794d43d08aff4d1db2a3c042)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:33.499349 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33f94a-52ab-4d31-a59a-dbb53d6e66b9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:33.501169 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 573/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:33 2022] GET /identity/v3/projects/fc152608794d43d08aff4d1db2a3c042 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:33.507213 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274130ba-a48e-4034-9fc9-2fca2a26b495 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:33.608642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274130ba-a48e-4034-9fc9-2fca2a26b495 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:33.642285 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21d001-2562-453b-99b6-2b73687572b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:33.642929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d001-2562-453b-99b6-2b73687572b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:33.643208 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d001-2562-453b-99b6-2b73687572b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:33.643479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d001-2562-453b-99b6-2b73687572b2 None admin] PATH_INFO: `/v3/projects/fc152608794d43d08aff4d1db2a3c042/users/c6e0ed33897c44b4b5e78b8b90bc44ac/roles/afe88bc03d30494b89892587177c79de` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:33.645334 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21d001-2562-453b-99b6-2b73687572b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fc152608794d43d08aff4d1db2a3c042, user_id=c6e0ed33897c44b4b5e78b8b90bc44ac, role_id=afe88bc03d30494b89892587177c79de)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:33.646773 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21d001-2562-453b-99b6-2b73687572b2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:33.729355 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 580/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:13:33 2022] PUT /identity/v3/projects/fc152608794d43d08aff4d1db2a3c042/users/c6e0ed33897c44b4b5e78b8b90bc44ac/roles/afe88bc03d30494b89892587177c79de => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:13:35.600995 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72909-68bb-4db4-8c9c-0891cc4b6003 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:35.601454 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72909-68bb-4db4-8c9c-0891cc4b6003 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:35.601546 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad72909-68bb-4db4-8c9c-0891cc4b6003 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:35.602900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 574/1154] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:35.608768 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d1843-a86b-4a0c-b285-c8bafac4d042 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:35.609194 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d1843-a86b-4a0c-b285-c8bafac4d042 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:35.609324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d1843-a86b-4a0c-b285-c8bafac4d042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:35.628001 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-fa1d1843-a86b-4a0c-b285-c8bafac4d042 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:35.629165 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-fa1d1843-a86b-4a0c-b285-c8bafac4d042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:35.648591 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:35.693762 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 581/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:35.962069 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad72909-68bb-4db4-8c9c-0891cc4b6003 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:35.978118 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:36.063948 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad72909-68bb-4db4-8c9c-0891cc4b6003 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:36.098358 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78217f-2b85-4e2d-8147-b6be673d6a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:36.098976 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78217f-2b85-4e2d-8147-b6be673d6a90 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:36.101637 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78217f-2b85-4e2d-8147-b6be673d6a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:36.101637 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78217f-2b85-4e2d-8147-b6be673d6a90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:36.109516 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78217f-2b85-4e2d-8147-b6be673d6a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-1f78217f-2b85-4e2d-8147-b6be673d6a90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:36.114463 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:36.115664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:13:36.116694 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 575/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:36.121671 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d1843-a86b-4a0c-b285-c8bafac4d042 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:36.219104 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d1843-a86b-4a0c-b285-c8bafac4d042 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:36.251836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54d98c-7fc2-471b-99a2-120219b4b547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:36.252436 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54d98c-7fc2-471b-99a2-120219b4b547 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:36.252718 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54d98c-7fc2-471b-99a2-120219b4b547 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:36.252990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54d98c-7fc2-471b-99a2-120219b4b547 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:36.253647 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54d98c-7fc2-471b-99a2-120219b4b547 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:36.253949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54d98c-7fc2-471b-99a2-120219b4b547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:36.255336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54d98c-7fc2-471b-99a2-120219b4b547 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:36.263706 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 582/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:13:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:36.269529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78217f-2b85-4e2d-8147-b6be673d6a90 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:36.338645 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:36.368341 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78217f-2b85-4e2d-8147-b6be673d6a90 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:36.401843 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a711a-ac5d-413f-8361-af47fb2dc25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:36.403108 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a711a-ac5d-413f-8361-af47fb2dc25b None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:36.403382 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a711a-ac5d-413f-8361-af47fb2dc25b None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:36.403647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a711a-ac5d-413f-8361-af47fb2dc25b None admin] PATH_INFO: `/v3/users/c6e0ed33897c44b4b5e78b8b90bc44ac` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:36.404743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a711a-ac5d-413f-8361-af47fb2dc25b None admin] RBAC: Authorizing `identity:get_user(user_id=c6e0ed33897c44b4b5e78b8b90bc44ac)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:36.406173 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a711a-ac5d-413f-8361-af47fb2dc25b None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:36.407712 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 576/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:36 2022] GET /identity/v3/users/c6e0ed33897c44b4b5e78b8b90bc44ac => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:36.413620 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54d98c-7fc2-471b-99a2-120219b4b547 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:36.432746 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:36.515458 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54d98c-7fc2-471b-99a2-120219b4b547 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:36.547803 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72541b75-b06a-424a-81d9-8e6219fe0e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:36.548395 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72541b75-b06a-424a-81d9-8e6219fe0e5c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:36.548673 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72541b75-b06a-424a-81d9-8e6219fe0e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:36.548944 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72541b75-b06a-424a-81d9-8e6219fe0e5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:36.615027 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72541b75-b06a-424a-81d9-8e6219fe0e5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:36.616456 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72541b75-b06a-424a-81d9-8e6219fe0e5c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:36.633392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:36.710587 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 583/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:13:36.716690 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a711a-ac5d-413f-8361-af47fb2dc25b None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:36.814470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a711a-ac5d-413f-8361-af47fb2dc25b None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:36.846557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241cf791-1293-4516-b11e-30db4fd016a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:36.847158 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cf791-1293-4516-b11e-30db4fd016a9 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:36.847432 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cf791-1293-4516-b11e-30db4fd016a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:36.847705 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241cf791-1293-4516-b11e-30db4fd016a9 None admin] PATH_INFO: `/v3/projects/fc152608794d43d08aff4d1db2a3c042` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:36.848786 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cf791-1293-4516-b11e-30db4fd016a9 None admin] RBAC: Authorizing `identity:get_project(project_id=fc152608794d43d08aff4d1db2a3c042)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:36.850218 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241cf791-1293-4516-b11e-30db4fd016a9 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:36.851787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 577/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:36 2022] GET /identity/v3/projects/fc152608794d43d08aff4d1db2a3c042 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:36.858405 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72541b75-b06a-424a-81d9-8e6219fe0e5c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:36.953326 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72541b75-b06a-424a-81d9-8e6219fe0e5c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:36.969486 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:36.985799 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802e63a-66af-4a0f-89fb-b64927eca087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:36.986425 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802e63a-66af-4a0f-89fb-b64927eca087 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:36.986705 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802e63a-66af-4a0f-89fb-b64927eca087 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:36.986976 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802e63a-66af-4a0f-89fb-b64927eca087 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:36.987685 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802e63a-66af-4a0f-89fb-b64927eca087 None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=fc152608794d43d08aff4d1db2a3c042, user.id=c6e0ed33897c44b4b5e78b8b90bc44ac) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:36.987991 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802e63a-66af-4a0f-89fb-b64927eca087 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:36.989397 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802e63a-66af-4a0f-89fb-b64927eca087 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:36.995053 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 584/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:13:36 2022] GET /identity/v3/role_assignments?user.id=c6e0ed33897c44b4b5e78b8b90bc44ac&scope.project.id=fc152608794d43d08aff4d1db2a3c042&role.id=afe88bc03d30494b89892587177c79de => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:38.893072 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826db4b7-a491-4da1-a640-82b85d8c18d8 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:38.893599 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826db4b7-a491-4da1-a640-82b85d8c18d8 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:38.893703 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826db4b7-a491-4da1-a640-82b85d8c18d8 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:38.895132 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 578/1162] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:38.900412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8634-dfe8-4eaa-b82e-8bab4168e1fa None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:38.900812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8634-dfe8-4eaa-b82e-8bab4168e1fa None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:38.900956 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8634-dfe8-4eaa-b82e-8bab4168e1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:38.919850 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-abab8634-dfe8-4eaa-b82e-8bab4168e1fa None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:38.921021 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-abab8634-dfe8-4eaa-b82e-8bab4168e1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:38.985803 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 585/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:39.249693 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826db4b7-a491-4da1-a640-82b85d8c18d8 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:39.261031 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:39.349637 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826db4b7-a491-4da1-a640-82b85d8c18d8 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:39.382456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13950-a658-4238-9c1f-19dddb35ab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:39.383047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13950-a658-4238-9c1f-19dddb35ab17 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:39.383329 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13950-a658-4238-9c1f-19dddb35ab17 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:39.383601 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13950-a658-4238-9c1f-19dddb35ab17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:39.448769 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e13950-a658-4238-9c1f-19dddb35ab17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:39.450855 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e13950-a658-4238-9c1f-19dddb35ab17 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:39.459992 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:39.545744 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 579/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:13:39.551556 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab8634-dfe8-4eaa-b82e-8bab4168e1fa None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:39.648212 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab8634-dfe8-4eaa-b82e-8bab4168e1fa None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:39.660861 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:39.680811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66e431-fd7d-4c1c-89a2-bdf97c594633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:39.681426 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66e431-fd7d-4c1c-89a2-bdf97c594633 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:39.681702 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66e431-fd7d-4c1c-89a2-bdf97c594633 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:39.681970 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66e431-fd7d-4c1c-89a2-bdf97c594633 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:39.689321 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66e431-fd7d-4c1c-89a2-bdf97c594633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:39.691039 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66e431-fd7d-4c1c-89a2-bdf97c594633 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-ef66e431-fd7d-4c1c-89a2-bdf97c594633 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:39.702910 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:39.704068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:39.705024 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 586/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 07:13:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:39.709899 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13950-a658-4238-9c1f-19dddb35ab17 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:39.806244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13950-a658-4238-9c1f-19dddb35ab17 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:39.815882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:39.839471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8391329-0dbf-4062-8aac-65de9224e620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:39.840055 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391329-0dbf-4062-8aac-65de9224e620 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:39.840332 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391329-0dbf-4062-8aac-65de9224e620 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:39.840724 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391329-0dbf-4062-8aac-65de9224e620 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:39.841357 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391329-0dbf-4062-8aac-65de9224e620 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:39.841656 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391329-0dbf-4062-8aac-65de9224e620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:39.843086 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391329-0dbf-4062-8aac-65de9224e620 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:39.850484 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 580/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 23 07:13:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:41.728157 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba9c24-10a3-42b2-bac2-f64bf2e566fd None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:41.728697 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba9c24-10a3-42b2-bac2-f64bf2e566fd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:41.728697 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba9c24-10a3-42b2-bac2-f64bf2e566fd None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:41.730049 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 587/1167] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:41.736103 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5473-0ff4-42ce-b4b8-8f5a9c4b8152 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:41.736489 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5473-0ff4-42ce-b4b8-8f5a9c4b8152 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:41.736659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e5473-0ff4-42ce-b4b8-8f5a9c4b8152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:41.754382 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-114e5473-0ff4-42ce-b4b8-8f5a9c4b8152 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:41.755561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-114e5473-0ff4-42ce-b4b8-8f5a9c4b8152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:41.820282 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 581/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 07:13:42.090203 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba9c24-10a3-42b2-bac2-f64bf2e566fd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:42.190253 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba9c24-10a3-42b2-bac2-f64bf2e566fd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:42.223100 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913053c4-5e22-406a-9d73-7d2ed2157b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:42.223685 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913053c4-5e22-406a-9d73-7d2ed2157b00 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:42.223963 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913053c4-5e22-406a-9d73-7d2ed2157b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:42.224234 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913053c4-5e22-406a-9d73-7d2ed2157b00 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:42.224879 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913053c4-5e22-406a-9d73-7d2ed2157b00 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:42.226264 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913053c4-5e22-406a-9d73-7d2ed2157b00 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:42.296780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 588/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Tue Aug 23 07:13:42 2022] POST /identity/v3/domains => generated 267 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:13:44.208560 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410da6-cd95-4fff-bcc6-4e6ad500bbc4 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:44.209111 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410da6-cd95-4fff-bcc6-4e6ad500bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:44.209111 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55410da6-cd95-4fff-bcc6-4e6ad500bbc4 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:44.210767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 582/1170] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:44.216171 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd32ca7-01d1-43d3-98bd-29c1c8a6b4aa None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:44.216649 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd32ca7-01d1-43d3-98bd-29c1c8a6b4aa None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:44.216741 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd32ca7-01d1-43d3-98bd-29c1c8a6b4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:44.235744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-4dd32ca7-01d1-43d3-98bd-29c1c8a6b4aa None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:44.236901 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-4dd32ca7-01d1-43d3-98bd-29c1c8a6b4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:44.262125 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:44.301933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 589/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:44.573794 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55410da6-cd95-4fff-bcc6-4e6ad500bbc4 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:44.672343 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55410da6-cd95-4fff-bcc6-4e6ad500bbc4 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:44.673853 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:44.705836 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4419d-3733-489d-90fa-be3d1bf551d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:44.706472 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4419d-3733-489d-90fa-be3d1bf551d1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:44.706751 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4419d-3733-489d-90fa-be3d1bf551d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:44.707022 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4419d-3733-489d-90fa-be3d1bf551d1 None admin] PATH_INFO: `/v3/domains/6efdab8ef5bb4de29ad55fc2e339d797` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:44.717688 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4419d-3733-489d-90fa-be3d1bf551d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6efdab8ef5bb4de29ad55fc2e339d797)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:44.719151 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4419d-3733-489d-90fa-be3d1bf551d1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:44.720699 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 583/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Tue Aug 23 07:13:44 2022] GET /identity/v3/domains/6efdab8ef5bb4de29ad55fc2e339d797 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:44.726507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd32ca7-01d1-43d3-98bd-29c1c8a6b4aa None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:44.823045 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd32ca7-01d1-43d3-98bd-29c1c8a6b4aa None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:44.857368 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08246b6-9a84-403d-8c87-a2efb26a832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:44.857898 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08246b6-9a84-403d-8c87-a2efb26a832d None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:44.858200 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08246b6-9a84-403d-8c87-a2efb26a832d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:44.858468 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08246b6-9a84-403d-8c87-a2efb26a832d None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:44.859095 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08246b6-9a84-403d-8c87-a2efb26a832d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:44.860503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08246b6-9a84-403d-8c87-a2efb26a832d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:44.964647 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 590/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:13:44 2022] POST /identity/v3/projects => generated 361 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:13:46.887470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d4000-5340-4ef1-b730-ed5913d10914 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:46.887979 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d4000-5340-4ef1-b730-ed5913d10914 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:46.888089 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d4000-5340-4ef1-b730-ed5913d10914 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:46.889787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 584/1174] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:46.895016 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef6029-1a9c-4b44-889b-544943bfedb2 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:46.895439 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef6029-1a9c-4b44-889b-544943bfedb2 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:46.895546 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ef6029-1a9c-4b44-889b-544943bfedb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:46.913883 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-d6ef6029-1a9c-4b44-889b-544943bfedb2 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:46.915109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-d6ef6029-1a9c-4b44-889b-544943bfedb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:46.924840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:46.981539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 591/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:47.249711 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d4000-5340-4ef1-b730-ed5913d10914 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:47.349126 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d4000-5340-4ef1-b730-ed5913d10914 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:47.380763 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570077e-368b-43db-a920-6fd4a09e7880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:47.381362 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570077e-368b-43db-a920-6fd4a09e7880 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:47.381636 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570077e-368b-43db-a920-6fd4a09e7880 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:47.381904 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570077e-368b-43db-a920-6fd4a09e7880 None admin] PATH_INFO: `/v3/domains/6efdab8ef5bb4de29ad55fc2e339d797` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:47.383012 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570077e-368b-43db-a920-6fd4a09e7880 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6efdab8ef5bb4de29ad55fc2e339d797)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:47.384425 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570077e-368b-43db-a920-6fd4a09e7880 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:47.385936 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 585/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Tue Aug 23 07:13:47 2022] GET /identity/v3/domains/6efdab8ef5bb4de29ad55fc2e339d797 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:47.392360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef6029-1a9c-4b44-889b-544943bfedb2 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:47.487592 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ef6029-1a9c-4b44-889b-544943bfedb2 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:47.520360 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293bac6-f6c8-4994-99b2-c6aae938f0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:47.520897 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293bac6-f6c8-4994-99b2-c6aae938f0dc None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:47.521174 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293bac6-f6c8-4994-99b2-c6aae938f0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:47.521445 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293bac6-f6c8-4994-99b2-c6aae938f0dc None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:47.522072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293bac6-f6c8-4994-99b2-c6aae938f0dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:47.523505 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293bac6-f6c8-4994-99b2-c6aae938f0dc None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:47.593490 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:47.598467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 592/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:13:47 2022] POST /identity/v3/users => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:13:49.542514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86182c97-b114-47e7-a660-f0e00932658a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:49.543191 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86182c97-b114-47e7-a660-f0e00932658a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:49.543191 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86182c97-b114-47e7-a660-f0e00932658a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:49.544497 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 586/1178] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:49.549646 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94027c-bdc5-45e4-91e1-35197d624ca6 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:49.550074 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94027c-bdc5-45e4-91e1-35197d624ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:49.550227 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94027c-bdc5-45e4-91e1-35197d624ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:49.568080 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-5d94027c-bdc5-45e4-91e1-35197d624ca6 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:49.569244 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-5d94027c-bdc5-45e4-91e1-35197d624ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:49.635626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 593/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:49.913368 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86182c97-b114-47e7-a660-f0e00932658a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:49.948877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:50.021030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86182c97-b114-47e7-a660-f0e00932658a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:50.054698 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ad1a2-7377-4397-935e-0c996e5873d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:50.055313 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ad1a2-7377-4397-935e-0c996e5873d3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:50.055614 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ad1a2-7377-4397-935e-0c996e5873d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:50.055892 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44ad1a2-7377-4397-935e-0c996e5873d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:50.066093 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44ad1a2-7377-4397-935e-0c996e5873d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-c44ad1a2-7377-4397-935e-0c996e5873d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:50.070741 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:50.071895 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:13:50.073178 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 587/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:13:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:50.078299 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94027c-bdc5-45e4-91e1-35197d624ca6 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:50.207298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94027c-bdc5-45e4-91e1-35197d624ca6 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:50.235609 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:50.241225 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9b056-9d98-485c-8d94-29c0a7a074a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:50.241822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9b056-9d98-485c-8d94-29c0a7a074a7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:50.242116 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9b056-9d98-485c-8d94-29c0a7a074a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:50.242574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9b056-9d98-485c-8d94-29c0a7a074a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:50.243223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9b056-9d98-485c-8d94-29c0a7a074a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:50.243524 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9b056-9d98-485c-8d94-29c0a7a074a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:50.244880 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9b056-9d98-485c-8d94-29c0a7a074a7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:50.252698 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 594/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:13:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:50.258529 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ad1a2-7377-4397-935e-0c996e5873d3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:50.350662 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:50.360211 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44ad1a2-7377-4397-935e-0c996e5873d3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:50.393423 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b963a42-0608-4717-aee7-84420e098d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:50.394034 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b963a42-0608-4717-aee7-84420e098d83 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:50.394337 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b963a42-0608-4717-aee7-84420e098d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:50.394608 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b963a42-0608-4717-aee7-84420e098d83 None admin] PATH_INFO: `/v3/users/3a968235a6e34e44ba85a6c35fbae684` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:50.407882 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b963a42-0608-4717-aee7-84420e098d83 None admin] RBAC: Authorizing `identity:get_user(user_id=3a968235a6e34e44ba85a6c35fbae684)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:50.409310 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b963a42-0608-4717-aee7-84420e098d83 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:50.410914 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 588/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:50 2022] GET /identity/v3/users/3a968235a6e34e44ba85a6c35fbae684 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:50.416854 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9b056-9d98-485c-8d94-29c0a7a074a7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:50.514776 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9b056-9d98-485c-8d94-29c0a7a074a7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:50.546807 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0be28-dbf1-4a81-9996-433b472cd984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:50.547412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0be28-dbf1-4a81-9996-433b472cd984 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:50.547669 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0be28-dbf1-4a81-9996-433b472cd984 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:50.547936 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0be28-dbf1-4a81-9996-433b472cd984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:50.604980 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:50.614060 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0be28-dbf1-4a81-9996-433b472cd984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:50.617315 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0be28-dbf1-4a81-9996-433b472cd984 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:50.710531 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 595/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:13:50.716807 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b963a42-0608-4717-aee7-84420e098d83 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:50.814149 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b963a42-0608-4717-aee7-84420e098d83 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:50.847410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae832a7e-0dbf-4187-a959-a253c6858f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:50.848022 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae832a7e-0dbf-4187-a959-a253c6858f02 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:50.848303 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae832a7e-0dbf-4187-a959-a253c6858f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:50.848576 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae832a7e-0dbf-4187-a959-a253c6858f02 None admin] PATH_INFO: `/v3/projects/5f2adf09be424887a9e622fbdfd9bd20` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:50.849676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae832a7e-0dbf-4187-a959-a253c6858f02 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2adf09be424887a9e622fbdfd9bd20)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:50.851114 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae832a7e-0dbf-4187-a959-a253c6858f02 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:50.852709 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 589/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:50 2022] GET /identity/v3/projects/5f2adf09be424887a9e622fbdfd9bd20 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:50.859498 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0be28-dbf1-4a81-9996-433b472cd984 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:50.946391 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:50.954606 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0be28-dbf1-4a81-9996-433b472cd984 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:50.988540 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab1d04-d1e2-4ef5-a72b-b3eff13fedfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:50.989126 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1d04-d1e2-4ef5-a72b-b3eff13fedfb None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:50.989400 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1d04-d1e2-4ef5-a72b-b3eff13fedfb None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:50.989666 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1d04-d1e2-4ef5-a72b-b3eff13fedfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:50.990400 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab1d04-d1e2-4ef5-a72b-b3eff13fedfb None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=5f2adf09be424887a9e622fbdfd9bd20, user.id=3a968235a6e34e44ba85a6c35fbae684) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:50.990703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab1d04-d1e2-4ef5-a72b-b3eff13fedfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:50.992100 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab1d04-d1e2-4ef5-a72b-b3eff13fedfb None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:50.997484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 596/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:13:50 2022] GET /identity/v3/role_assignments?user.id=3a968235a6e34e44ba85a6c35fbae684&scope.project.id=5f2adf09be424887a9e622fbdfd9bd20&role.id=afe88bc03d30494b89892587177c79de => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:52.860230 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18215253-719d-4539-b793-4af89df75dfe None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:52.860755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18215253-719d-4539-b793-4af89df75dfe None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:52.860755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18215253-719d-4539-b793-4af89df75dfe None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:52.862029 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 590/1186] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:52.867203 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e25ab9-8743-453e-8119-af5a9c415f49 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:52.867624 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e25ab9-8743-453e-8119-af5a9c415f49 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:52.867753 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e25ab9-8743-453e-8119-af5a9c415f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:52.885725 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-75e25ab9-8743-453e-8119-af5a9c415f49 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:52.887545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-75e25ab9-8743-453e-8119-af5a9c415f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:52.951500 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 597/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:53.221648 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18215253-719d-4539-b793-4af89df75dfe None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:53.240135 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:53.320567 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18215253-719d-4539-b793-4af89df75dfe None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:53.354484 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115d166-98dc-4630-bab1-1355dd5889ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:53.355093 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115d166-98dc-4630-bab1-1355dd5889ae None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:53.355369 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115d166-98dc-4630-bab1-1355dd5889ae None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:53.355637 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115d166-98dc-4630-bab1-1355dd5889ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:53.365893 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115d166-98dc-4630-bab1-1355dd5889ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-6115d166-98dc-4630-bab1-1355dd5889ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:53.370534 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:53.371609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:13:53.373082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 591/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:13:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:53.377747 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e25ab9-8743-453e-8119-af5a9c415f49 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:53.462277 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:53.477129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e25ab9-8743-453e-8119-af5a9c415f49 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:53.509475 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0e7d9-ca93-474f-ba65-6d9c6109ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:53.510069 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0e7d9-ca93-474f-ba65-6d9c6109ec37 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:53.510380 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0e7d9-ca93-474f-ba65-6d9c6109ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:53.510650 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0e7d9-ca93-474f-ba65-6d9c6109ec37 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:53.511304 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0e7d9-ca93-474f-ba65-6d9c6109ec37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:53.511604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0e7d9-ca93-474f-ba65-6d9c6109ec37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:53.513490 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0e7d9-ca93-474f-ba65-6d9c6109ec37 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:53.521233 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 598/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:13:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:53.526934 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115d166-98dc-4630-bab1-1355dd5889ae None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:53.603187 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:53.625636 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115d166-98dc-4630-bab1-1355dd5889ae None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:53.659387 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8b862-7dc6-4938-b9d7-9c68246289e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:53.659992 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8b862-7dc6-4938-b9d7-9c68246289e2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:53.660274 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8b862-7dc6-4938-b9d7-9c68246289e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:53.660541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8b862-7dc6-4938-b9d7-9c68246289e2 None admin] PATH_INFO: `/v3/users/3a968235a6e34e44ba85a6c35fbae684` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:53.661636 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8b862-7dc6-4938-b9d7-9c68246289e2 None admin] RBAC: Authorizing `identity:get_user(user_id=3a968235a6e34e44ba85a6c35fbae684)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:53.663084 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8b862-7dc6-4938-b9d7-9c68246289e2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:53.664627 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 592/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:53 2022] GET /identity/v3/users/3a968235a6e34e44ba85a6c35fbae684 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:53.670496 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0e7d9-ca93-474f-ba65-6d9c6109ec37 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:53.771060 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0e7d9-ca93-474f-ba65-6d9c6109ec37 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:53.803580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bfea5-dd83-4b7f-a757-b127a5e45a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:53.804192 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bfea5-dd83-4b7f-a757-b127a5e45a83 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:53.804470 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bfea5-dd83-4b7f-a757-b127a5e45a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:53.804741 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bfea5-dd83-4b7f-a757-b127a5e45a83 None admin] PATH_INFO: `/v3/projects/5f2adf09be424887a9e622fbdfd9bd20` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:53.805834 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bfea5-dd83-4b7f-a757-b127a5e45a83 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2adf09be424887a9e622fbdfd9bd20)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:53.807315 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bfea5-dd83-4b7f-a757-b127a5e45a83 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:53.808909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 599/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:53 2022] GET /identity/v3/projects/5f2adf09be424887a9e622fbdfd9bd20 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:53.815795 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8b862-7dc6-4938-b9d7-9c68246289e2 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:53.912800 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8b862-7dc6-4938-b9d7-9c68246289e2 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:53.945607 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d261bc4-a7f1-4287-8ae0-e4072b872755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:53.946268 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d261bc4-a7f1-4287-8ae0-e4072b872755 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:53.946543 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d261bc4-a7f1-4287-8ae0-e4072b872755 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:53.946808 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d261bc4-a7f1-4287-8ae0-e4072b872755 None admin] PATH_INFO: `/v3/projects/5f2adf09be424887a9e622fbdfd9bd20/users/3a968235a6e34e44ba85a6c35fbae684/roles/afe88bc03d30494b89892587177c79de` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:53.948635 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d261bc4-a7f1-4287-8ae0-e4072b872755 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f2adf09be424887a9e622fbdfd9bd20, user_id=3a968235a6e34e44ba85a6c35fbae684, role_id=afe88bc03d30494b89892587177c79de)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:53.950041 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d261bc4-a7f1-4287-8ae0-e4072b872755 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:54.031259 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 593/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:13:53 2022] PUT /identity/v3/projects/5f2adf09be424887a9e622fbdfd9bd20/users/3a968235a6e34e44ba85a6c35fbae684/roles/afe88bc03d30494b89892587177c79de => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:13:55.907929 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b740ee-ab44-43d4-a8e9-fa4da90db2b8 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:55.908466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b740ee-ab44-43d4-a8e9-fa4da90db2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:55.908466 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b740ee-ab44-43d4-a8e9-fa4da90db2b8 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:55.909856 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 600/1193] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:13:55.915597 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea98cc-954d-4847-80fa-2be4eadfc45f None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:55.916010 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea98cc-954d-4847-80fa-2be4eadfc45f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:55.916151 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea98cc-954d-4847-80fa-2be4eadfc45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:55.923410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:55.933764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-0bea98cc-954d-4847-80fa-2be4eadfc45f None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:13:55.936206 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-0bea98cc-954d-4847-80fa-2be4eadfc45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:13:56.001390 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 594/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:13:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:13:56.274483 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b740ee-ab44-43d4-a8e9-fa4da90db2b8 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:56.292653 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:56.374744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b740ee-ab44-43d4-a8e9-fa4da90db2b8 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:56.406955 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b10f1-08ac-4686-9a13-0ab6756ed62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:56.407571 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b10f1-08ac-4686-9a13-0ab6756ed62c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:56.407849 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b10f1-08ac-4686-9a13-0ab6756ed62c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:56.408120 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b10f1-08ac-4686-9a13-0ab6756ed62c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:56.417842 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b10f1-08ac-4686-9a13-0ab6756ed62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-650b10f1-08ac-4686-9a13-0ab6756ed62c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:13:56.423007 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:13:56.424109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:13:56.425161 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 601/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:13:56.430351 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea98cc-954d-4847-80fa-2be4eadfc45f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:56.526583 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea98cc-954d-4847-80fa-2be4eadfc45f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:56.558917 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f3c24-735d-4d57-b053-2a53140e97b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:56.560098 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f3c24-735d-4d57-b053-2a53140e97b1 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:56.560376 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f3c24-735d-4d57-b053-2a53140e97b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:56.560646 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f3c24-735d-4d57-b053-2a53140e97b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:56.561294 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f3c24-735d-4d57-b053-2a53140e97b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:56.561592 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f3c24-735d-4d57-b053-2a53140e97b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:56.562967 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f3c24-735d-4d57-b053-2a53140e97b1 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:56.564276 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:56.571337 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 595/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:13:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:56.577207 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b10f1-08ac-4686-9a13-0ab6756ed62c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:56.653000 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:56.676962 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b10f1-08ac-4686-9a13-0ab6756ed62c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:56.709056 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef090-25c4-4b5b-96fc-77dfa362d1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:56.709921 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef090-25c4-4b5b-96fc-77dfa362d1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:56.710223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef090-25c4-4b5b-96fc-77dfa362d1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:56.710491 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ef090-25c4-4b5b-96fc-77dfa362d1d1 None admin] PATH_INFO: `/v3/users/3a968235a6e34e44ba85a6c35fbae684` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:56.711579 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ef090-25c4-4b5b-96fc-77dfa362d1d1 None admin] RBAC: Authorizing `identity:get_user(user_id=3a968235a6e34e44ba85a6c35fbae684)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:56.712987 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ef090-25c4-4b5b-96fc-77dfa362d1d1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:56.714558 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 602/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Tue Aug 23 07:13:56 2022] GET /identity/v3/users/3a968235a6e34e44ba85a6c35fbae684 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:56.721082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f3c24-735d-4d57-b053-2a53140e97b1 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:56.817331 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f3c24-735d-4d57-b053-2a53140e97b1 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:56.850034 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b99adf-0f67-40fc-9e99-b7fa47fec150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:56.850643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b99adf-0f67-40fc-9e99-b7fa47fec150 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:56.850915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b99adf-0f67-40fc-9e99-b7fa47fec150 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:56.851186 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b99adf-0f67-40fc-9e99-b7fa47fec150 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:56.909212 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:56.915525 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b99adf-0f67-40fc-9e99-b7fa47fec150 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:56.917101 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b99adf-0f67-40fc-9e99-b7fa47fec150 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:57.013448 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 596/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:13:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:13:57.019408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef090-25c4-4b5b-96fc-77dfa362d1d1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:57.116722 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ef090-25c4-4b5b-96fc-77dfa362d1d1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:57.149259 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a573e4-6842-4f71-9abe-c8122afc3c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:57.149863 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a573e4-6842-4f71-9abe-c8122afc3c05 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:57.150158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a573e4-6842-4f71-9abe-c8122afc3c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:57.150428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a573e4-6842-4f71-9abe-c8122afc3c05 None admin] PATH_INFO: `/v3/projects/5f2adf09be424887a9e622fbdfd9bd20` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:57.151510 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a573e4-6842-4f71-9abe-c8122afc3c05 None admin] RBAC: Authorizing `identity:get_project(project_id=5f2adf09be424887a9e622fbdfd9bd20)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:57.152915 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a573e4-6842-4f71-9abe-c8122afc3c05 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:57.155442 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 603/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Tue Aug 23 07:13:57 2022] GET /identity/v3/projects/5f2adf09be424887a9e622fbdfd9bd20 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:13:57.161461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b99adf-0f67-40fc-9e99-b7fa47fec150 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:13:57.252019 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:13:57.257391 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b99adf-0f67-40fc-9e99-b7fa47fec150 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:13:57.290350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2cea-4be6-4a5c-80d9-ca5b284d299a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:13:57.290932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2cea-4be6-4a5c-80d9-ca5b284d299a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:13:57.291207 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2cea-4be6-4a5c-80d9-ca5b284d299a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:13:57.291477 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2cea-4be6-4a5c-80d9-ca5b284d299a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:13:57.292185 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e2cea-4be6-4a5c-80d9-ca5b284d299a None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=5f2adf09be424887a9e622fbdfd9bd20, user.id=3a968235a6e34e44ba85a6c35fbae684) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:13:57.292488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e2cea-4be6-4a5c-80d9-ca5b284d299a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:13:57.294020 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e2cea-4be6-4a5c-80d9-ca5b284d299a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:13:57.299576 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 597/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:13:57 2022] GET /identity/v3/role_assignments?user.id=3a968235a6e34e44ba85a6c35fbae684&scope.project.id=5f2adf09be424887a9e622fbdfd9bd20&role.id=afe88bc03d30494b89892587177c79de => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:14:07.145275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=94 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:14:07.297047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=20 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:06.416436 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe5b9-1b83-4da8-bd82-29a397a4e308 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:06.417020 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe5b9-1b83-4da8-bd82-29a397a4e308 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:06.417020 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fe5b9-1b83-4da8-bd82-29a397a4e308 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:06.418366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 604/1201] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:15:06.424271 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb166b-a7bf-42ac-99a8-f05c5781ff31 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:06.424681 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb166b-a7bf-42ac-99a8-f05c5781ff31 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:06.424838 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb166b-a7bf-42ac-99a8-f05c5781ff31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:06.442777 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-acbb166b-a7bf-42ac-99a8-f05c5781ff31 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:15:06.443943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-acbb166b-a7bf-42ac-99a8-f05c5781ff31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:15:06.509159 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 598/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:15:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:15:06.780850 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fe5b9-1b83-4da8-bd82-29a397a4e308 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:06.880917 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fe5b9-1b83-4da8-bd82-29a397a4e308 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:06.914435 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faacfc-26e0-455b-bf57-8ea9acbd6d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:06.915090 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faacfc-26e0-455b-bf57-8ea9acbd6d2d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:06.915371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faacfc-26e0-455b-bf57-8ea9acbd6d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:06.915643 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faacfc-26e0-455b-bf57-8ea9acbd6d2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:06.925922 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faacfc-26e0-455b-bf57-8ea9acbd6d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:06.927386 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faacfc-26e0-455b-bf57-8ea9acbd6d2d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-92faacfc-26e0-455b-bf57-8ea9acbd6d2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:06.942286 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:06.943329 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:06.944293 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:06.944293 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:06.944293 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:06.944293 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 605/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:06.949480 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb166b-a7bf-42ac-99a8-f05c5781ff31 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:07.049848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb166b-a7bf-42ac-99a8-f05c5781ff31 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:07.078414 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:07.084433 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7b1e5-e3d9-4cc3-9b14-4374e6b2e4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:07.085028 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7b1e5-e3d9-4cc3-9b14-4374e6b2e4ff None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:07.089731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7b1e5-e3d9-4cc3-9b14-4374e6b2e4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:07.089731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7b1e5-e3d9-4cc3-9b14-4374e6b2e4ff None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:07.089731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7b1e5-e3d9-4cc3-9b14-4374e6b2e4ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:07.089731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7b1e5-e3d9-4cc3-9b14-4374e6b2e4ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:07.089731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7b1e5-e3d9-4cc3-9b14-4374e6b2e4ff None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:07.099336 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 599/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:07.105508 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faacfc-26e0-455b-bf57-8ea9acbd6d2d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:07.158251 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:07.204423 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faacfc-26e0-455b-bf57-8ea9acbd6d2d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:07.238389 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148429-05d8-4216-9ea0-e8ccbbc5bc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:07.238985 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148429-05d8-4216-9ea0-e8ccbbc5bc80 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:07.239263 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148429-05d8-4216-9ea0-e8ccbbc5bc80 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:07.239532 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148429-05d8-4216-9ea0-e8ccbbc5bc80 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:07.240158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148429-05d8-4216-9ea0-e8ccbbc5bc80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:07.241580 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148429-05d8-4216-9ea0-e8ccbbc5bc80 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:07.331836 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 606/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Tue Aug 23 07:15:07 2022] POST /identity/v3/users => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:15:09.266927 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eff77e-8adf-4d92-8ab3-5f22fdccd344 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:09.267484 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eff77e-8adf-4d92-8ab3-5f22fdccd344 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:09.267484 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eff77e-8adf-4d92-8ab3-5f22fdccd344 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:09.268842 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 600/1206] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:15:09.274257 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68206052-90f0-4576-b500-22cb4846f527 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:09.274711 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68206052-90f0-4576-b500-22cb4846f527 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:09.274816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68206052-90f0-4576-b500-22cb4846f527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:09.293174 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-68206052-90f0-4576-b500-22cb4846f527 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:15:09.294404 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-68206052-90f0-4576-b500-22cb4846f527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:15:09.360128 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 607/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:15:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:15:09.635013 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eff77e-8adf-4d92-8ab3-5f22fdccd344 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:09.736929 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eff77e-8adf-4d92-8ab3-5f22fdccd344 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:09.771002 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29054978-397b-4f24-8fc0-3f7fda7a4f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:09.771630 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29054978-397b-4f24-8fc0-3f7fda7a4f32 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:09.771908 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29054978-397b-4f24-8fc0-3f7fda7a4f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:09.772175 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29054978-397b-4f24-8fc0-3f7fda7a4f32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:09.782114 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29054978-397b-4f24-8fc0-3f7fda7a4f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-29054978-397b-4f24-8fc0-3f7fda7a4f32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:15:09.786725 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:09.798639 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:09.799565 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 601/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:15:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:09.800374 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68206052-90f0-4576-b500-22cb4846f527 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:09.833840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:09.891916 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68206052-90f0-4576-b500-22cb4846f527 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:09.925203 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376599d-4c5d-4732-9bcb-a5c2431bd925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:09.925805 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376599d-4c5d-4732-9bcb-a5c2431bd925 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:09.926084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376599d-4c5d-4732-9bcb-a5c2431bd925 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:09.926383 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376599d-4c5d-4732-9bcb-a5c2431bd925 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:09.927040 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376599d-4c5d-4732-9bcb-a5c2431bd925 None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:09.927341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376599d-4c5d-4732-9bcb-a5c2431bd925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:09.928698 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e376599d-4c5d-4732-9bcb-a5c2431bd925 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:09.937699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 608/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:15:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:09.947239 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29054978-397b-4f24-8fc0-3f7fda7a4f32 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:09.994546 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:10.042323 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29054978-397b-4f24-8fc0-3f7fda7a4f32 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:10.076341 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f0e62-8904-4386-9cf1-a1d9c1f614ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:10.076986 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0e62-8904-4386-9cf1-a1d9c1f614ba None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:10.077265 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0e62-8904-4386-9cf1-a1d9c1f614ba None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:10.077540 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f0e62-8904-4386-9cf1-a1d9c1f614ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:10.088968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f0e62-8904-4386-9cf1-a1d9c1f614ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:10.091087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f0e62-8904-4386-9cf1-a1d9c1f614ba None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7d0f0e62-8904-4386-9cf1-a1d9c1f614ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:10.104787 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:10.108881 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:10.110006 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:10.110006 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:10.110006 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:10.110006 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 602/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:10.112758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376599d-4c5d-4732-9bcb-a5c2431bd925 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:10.209924 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:10.212815 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376599d-4c5d-4732-9bcb-a5c2431bd925 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:10.246801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bad1d-b958-4926-af2b-d1c27eb31e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:10.247463 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bad1d-b958-4926-af2b-d1c27eb31e46 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:10.247744 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bad1d-b958-4926-af2b-d1c27eb31e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:10.248011 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6bad1d-b958-4926-af2b-d1c27eb31e46 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:10.248641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bad1d-b958-4926-af2b-d1c27eb31e46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:10.248938 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bad1d-b958-4926-af2b-d1c27eb31e46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:10.250357 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6bad1d-b958-4926-af2b-d1c27eb31e46 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:10.261172 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 609/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:10.267147 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f0e62-8904-4386-9cf1-a1d9c1f614ba None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:10.369153 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f0e62-8904-4386-9cf1-a1d9c1f614ba None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:10.370817 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:10.403361 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb97f8-1088-42d7-a93e-95a7334c4f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:10.404079 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb97f8-1088-42d7-a93e-95a7334c4f7c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:10.404356 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb97f8-1088-42d7-a93e-95a7334c4f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:10.404625 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb97f8-1088-42d7-a93e-95a7334c4f7c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:10.411561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb97f8-1088-42d7-a93e-95a7334c4f7c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:10.412992 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb97f8-1088-42d7-a93e-95a7334c4f7c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-cdeb97f8-1088-42d7-a93e-95a7334c4f7c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:15:10.424222 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:10.427115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:10.428058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:10.428058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:10.428058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:15:10.428058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:15:10.428058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:15:10.428058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:15:10.428058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:15:10.428058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:15:10.428058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:10.428058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:10.428058 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 603/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:10.431266 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bad1d-b958-4926-af2b-d1c27eb31e46 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:10.531144 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6bad1d-b958-4926-af2b-d1c27eb31e46 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:10.563802 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97a390-1aa1-4776-b29a-c0c701bacd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:10.564402 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a390-1aa1-4776-b29a-c0c701bacd14 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:10.564680 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a390-1aa1-4776-b29a-c0c701bacd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:10.564951 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97a390-1aa1-4776-b29a-c0c701bacd14 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:10.565668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97a390-1aa1-4776-b29a-c0c701bacd14 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:10.565970 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97a390-1aa1-4776-b29a-c0c701bacd14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:10.567428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97a390-1aa1-4776-b29a-c0c701bacd14 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:10.586577 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 610/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 07:15:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:10.593055 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb97f8-1088-42d7-a93e-95a7334c4f7c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:10.692371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb97f8-1088-42d7-a93e-95a7334c4f7c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:10.726415 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d59b9-0681-49c3-9afb-4f4868ba6586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:10.727017 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d59b9-0681-49c3-9afb-4f4868ba6586 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:10.727276 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d59b9-0681-49c3-9afb-4f4868ba6586 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:10.727544 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d59b9-0681-49c3-9afb-4f4868ba6586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:10.757216 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:10.794176 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d59b9-0681-49c3-9afb-4f4868ba6586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:10.795554 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d59b9-0681-49c3-9afb-4f4868ba6586 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:10.892348 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 604/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:15:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:15:10.898326 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97a390-1aa1-4776-b29a-c0c701bacd14 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:10.917061 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:10.994668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97a390-1aa1-4776-b29a-c0c701bacd14 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:11.028295 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4ff50-551e-49b7-9133-148b77d99d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:11.028912 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4ff50-551e-49b7-9133-148b77d99d6d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:11.029189 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4ff50-551e-49b7-9133-148b77d99d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:11.029462 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4ff50-551e-49b7-9133-148b77d99d6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:11.039514 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4ff50-551e-49b7-9133-148b77d99d6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:11.041047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4ff50-551e-49b7-9133-148b77d99d6d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-f9a4ff50-551e-49b7-9133-148b77d99d6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:11.055513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:11.056626 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:11.057507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:11.057507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:11.057507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:11.057507 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 611/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:11.063007 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d59b9-0681-49c3-9afb-4f4868ba6586 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:11.124310 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:11.160057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d59b9-0681-49c3-9afb-4f4868ba6586 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:11.193055 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971557ea-deda-46da-8d85-aafd76c254e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:11.193641 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971557ea-deda-46da-8d85-aafd76c254e3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:11.193915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971557ea-deda-46da-8d85-aafd76c254e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:11.194207 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971557ea-deda-46da-8d85-aafd76c254e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:11.194835 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971557ea-deda-46da-8d85-aafd76c254e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:11.195127 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971557ea-deda-46da-8d85-aafd76c254e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:11.196470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971557ea-deda-46da-8d85-aafd76c254e3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:11.209095 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 605/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:11.215220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4ff50-551e-49b7-9133-148b77d99d6d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:11.284088 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:11.315983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4ff50-551e-49b7-9133-148b77d99d6d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:11.349038 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad9ffb-4723-4835-95a9-7e691cbd6c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:11.349658 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad9ffb-4723-4835-95a9-7e691cbd6c9e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:11.349935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad9ffb-4723-4835-95a9-7e691cbd6c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:11.350239 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad9ffb-4723-4835-95a9-7e691cbd6c9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:11.357407 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad9ffb-4723-4835-95a9-7e691cbd6c9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:11.359042 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad9ffb-4723-4835-95a9-7e691cbd6c9e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-b2ad9ffb-4723-4835-95a9-7e691cbd6c9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:15:11.370453 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:11.372163 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:11.373339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:15:11.373339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:15:11.373339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:15:11.373339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:15:11.373339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:15:11.373339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:15:11.373339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:11.373339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:11.373339 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 612/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:15:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:11.378082 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971557ea-deda-46da-8d85-aafd76c254e3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:11.476236 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971557ea-deda-46da-8d85-aafd76c254e3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:11.498898 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:11.510311 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd7898-a4c4-418f-90bc-312b02159a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:11.510903 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd7898-a4c4-418f-90bc-312b02159a40 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:11.511202 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd7898-a4c4-418f-90bc-312b02159a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:11.511550 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd7898-a4c4-418f-90bc-312b02159a40 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:11.512197 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd7898-a4c4-418f-90bc-312b02159a40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:11.512561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd7898-a4c4-418f-90bc-312b02159a40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:11.514004 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd7898-a4c4-418f-90bc-312b02159a40 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:11.525107 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 606/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:15:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:11.531805 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad9ffb-4723-4835-95a9-7e691cbd6c9e None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:11.631353 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad9ffb-4723-4835-95a9-7e691cbd6c9e None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:11.658969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:11.664562 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b9938-64a1-4258-90b6-84af2b9748ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:11.665154 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9938-64a1-4258-90b6-84af2b9748ac None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:11.665428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9938-64a1-4258-90b6-84af2b9748ac None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:11.665697 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b9938-64a1-4258-90b6-84af2b9748ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:11.666479 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b9938-64a1-4258-90b6-84af2b9748ac None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=60dba803c4c04821a18fa1e3fc6db104) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:11.666777 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b9938-64a1-4258-90b6-84af2b9748ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:11.668851 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b9938-64a1-4258-90b6-84af2b9748ac None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:11.674371 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 613/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:15:11 2022] GET /identity/v3/role_assignments?user.id=60dba803c4c04821a18fa1e3fc6db104&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:13.550971 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab36613-1eef-4ca6-a69a-427d93edbf95 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:13.551526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab36613-1eef-4ca6-a69a-427d93edbf95 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:13.551526 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab36613-1eef-4ca6-a69a-427d93edbf95 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:13.552918 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 607/1220] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:15:13.558321 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1071d-bd8d-4efb-9fbc-83c0671cadbd None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:13.562009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1071d-bd8d-4efb-9fbc-83c0671cadbd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:13.562009 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1071d-bd8d-4efb-9fbc-83c0671cadbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:13.577306 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-71b1071d-bd8d-4efb-9fbc-83c0671cadbd None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:15:13.578503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-71b1071d-bd8d-4efb-9fbc-83c0671cadbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:15:13.644638 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 614/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:15:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:15:13.917046 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab36613-1eef-4ca6-a69a-427d93edbf95 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:14.018427 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab36613-1eef-4ca6-a69a-427d93edbf95 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:14.052778 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586f9a6-24bb-4704-a448-e70c2601417f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:14.053800 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586f9a6-24bb-4704-a448-e70c2601417f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:14.054325 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586f9a6-24bb-4704-a448-e70c2601417f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:14.054812 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586f9a6-24bb-4704-a448-e70c2601417f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:14.065339 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586f9a6-24bb-4704-a448-e70c2601417f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-d586f9a6-24bb-4704-a448-e70c2601417f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:15:14.069923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:14.070912 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:14.071916 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 608/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:15:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:14.077863 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1071d-bd8d-4efb-9fbc-83c0671cadbd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:14.178075 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1071d-bd8d-4efb-9fbc-83c0671cadbd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:14.201996 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:14.212941 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df054c5-6472-4de7-8f9e-9675b19e9f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:14.213545 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df054c5-6472-4de7-8f9e-9675b19e9f7b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:14.213824 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df054c5-6472-4de7-8f9e-9675b19e9f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:14.214095 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df054c5-6472-4de7-8f9e-9675b19e9f7b None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:14.215440 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df054c5-6472-4de7-8f9e-9675b19e9f7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:14.215739 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df054c5-6472-4de7-8f9e-9675b19e9f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:14.217098 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df054c5-6472-4de7-8f9e-9675b19e9f7b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:14.224959 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 615/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:15:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:15:14.231067 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586f9a6-24bb-4704-a448-e70c2601417f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:14.273839 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:14.329793 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586f9a6-24bb-4704-a448-e70c2601417f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:14.363932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc42e74-1f16-418f-885a-dd24d4887ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:14.364538 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42e74-1f16-418f-885a-dd24d4887ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:14.364812 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42e74-1f16-418f-885a-dd24d4887ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:14.365078 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc42e74-1f16-418f-885a-dd24d4887ae3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:14.376208 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc42e74-1f16-418f-885a-dd24d4887ae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:14.377649 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc42e74-1f16-418f-885a-dd24d4887ae3 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-ddc42e74-1f16-418f-885a-dd24d4887ae3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:14.392764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:14.393885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:14.395054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:14.395054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:14.395054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:14.395054 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 609/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:14.399745 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df054c5-6472-4de7-8f9e-9675b19e9f7b None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:14.500921 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df054c5-6472-4de7-8f9e-9675b19e9f7b None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:14.534480 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067223-4cff-46dd-875b-e10cc2adaca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:14.535141 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067223-4cff-46dd-875b-e10cc2adaca4 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:14.535467 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067223-4cff-46dd-875b-e10cc2adaca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:14.535743 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07067223-4cff-46dd-875b-e10cc2adaca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:14.536385 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067223-4cff-46dd-875b-e10cc2adaca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:14.536685 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067223-4cff-46dd-875b-e10cc2adaca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:14.538132 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07067223-4cff-46dd-875b-e10cc2adaca4 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:14.550279 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 616/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:14.556037 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc42e74-1f16-418f-885a-dd24d4887ae3 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:14.650262 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:14.657069 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc42e74-1f16-418f-885a-dd24d4887ae3 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:14.691316 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08556f7-08c2-4d7c-bdea-8bb9dbb65156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:14.691933 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08556f7-08c2-4d7c-bdea-8bb9dbb65156 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:14.692211 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08556f7-08c2-4d7c-bdea-8bb9dbb65156 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:14.692483 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08556f7-08c2-4d7c-bdea-8bb9dbb65156 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:14.700256 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08556f7-08c2-4d7c-bdea-8bb9dbb65156 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:14.701810 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08556f7-08c2-4d7c-bdea-8bb9dbb65156 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-a08556f7-08c2-4d7c-bdea-8bb9dbb65156 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:15:14.713335 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:14.716659 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:14.717877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:14.717877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:14.717877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:15:14.717877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:15:14.717877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:15:14.717877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:15:14.717877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:15:14.717877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:15:14.717877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:14.717877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:14.717877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 610/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:14.720690 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067223-4cff-46dd-875b-e10cc2adaca4 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:14.767856 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:14.820074 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07067223-4cff-46dd-875b-e10cc2adaca4 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:14.856027 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921c986-9d9e-4529-859f-4a1d0b17b6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:14.856632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921c986-9d9e-4529-859f-4a1d0b17b6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:14.856909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921c986-9d9e-4529-859f-4a1d0b17b6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:14.857175 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921c986-9d9e-4529-859f-4a1d0b17b6d1 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:14.857890 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921c986-9d9e-4529-859f-4a1d0b17b6d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:14.858219 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921c986-9d9e-4529-859f-4a1d0b17b6d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:14.859642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921c986-9d9e-4529-859f-4a1d0b17b6d1 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:14.876812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 617/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 07:15:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:14.882803 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08556f7-08c2-4d7c-bdea-8bb9dbb65156 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:14.984385 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08556f7-08c2-4d7c-bdea-8bb9dbb65156 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:15.018163 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93714d6-a591-472c-8731-e73a6f592a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:15.018723 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93714d6-a591-472c-8731-e73a6f592a0c None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:15.019004 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93714d6-a591-472c-8731-e73a6f592a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:15.019330 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93714d6-a591-472c-8731-e73a6f592a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:15.030231 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93714d6-a591-472c-8731-e73a6f592a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:15.031664 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93714d6-a591-472c-8731-e73a6f592a0c None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e93714d6-a591-472c-8731-e73a6f592a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:15.045582 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:15.050900 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:15.052047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:15.052047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:15.052047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:15.052047 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 611/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:15.052817 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921c986-9d9e-4529-859f-4a1d0b17b6d1 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:15.153811 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921c986-9d9e-4529-859f-4a1d0b17b6d1 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:15.156084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:15.187128 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e4f9e-e6c9-49e0-8f59-da70ef14d21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:15.187723 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e4f9e-e6c9-49e0-8f59-da70ef14d21c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:15.187999 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e4f9e-e6c9-49e0-8f59-da70ef14d21c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:15.188272 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e4f9e-e6c9-49e0-8f59-da70ef14d21c None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:15.188894 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e4f9e-e6c9-49e0-8f59-da70ef14d21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:15.189186 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e4f9e-e6c9-49e0-8f59-da70ef14d21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:15.190574 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e4f9e-e6c9-49e0-8f59-da70ef14d21c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:15.201832 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 618/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:15.208192 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93714d6-a591-472c-8731-e73a6f592a0c None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:15.218446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:15.308704 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93714d6-a591-472c-8731-e73a6f592a0c None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:15.341982 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4fff6-c06e-44df-8f28-bb80fd3bf8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:15.342650 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4fff6-c06e-44df-8f28-bb80fd3bf8cc None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:15.342926 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4fff6-c06e-44df-8f28-bb80fd3bf8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:15.343194 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4fff6-c06e-44df-8f28-bb80fd3bf8cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:15.349745 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4fff6-c06e-44df-8f28-bb80fd3bf8cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:15.351215 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4fff6-c06e-44df-8f28-bb80fd3bf8cc None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-96f4fff6-c06e-44df-8f28-bb80fd3bf8cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:15:15.362939 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:15.368737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:15.369673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:15:15.369673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:15:15.369673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:15:15.369673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:15:15.369673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:15:15.369673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:15:15.369673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:15.369673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:15.369673 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 612/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:15:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:15.370187 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e4f9e-e6c9-49e0-8f59-da70ef14d21c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:15.467885 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e4f9e-e6c9-49e0-8f59-da70ef14d21c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:15.502440 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a219273-a8cd-49e9-a6a8-d27e0cb8dd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:15.503047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a219273-a8cd-49e9-a6a8-d27e0cb8dd5e None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:15.503325 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a219273-a8cd-49e9-a6a8-d27e0cb8dd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:15.503595 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a219273-a8cd-49e9-a6a8-d27e0cb8dd5e None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:15.504274 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a219273-a8cd-49e9-a6a8-d27e0cb8dd5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:15.504575 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a219273-a8cd-49e9-a6a8-d27e0cb8dd5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:15.505992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a219273-a8cd-49e9-a6a8-d27e0cb8dd5e None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:15.517717 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 619/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:15:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:15.523972 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4fff6-c06e-44df-8f28-bb80fd3bf8cc None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:15.589176 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:15.625446 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4fff6-c06e-44df-8f28-bb80fd3bf8cc None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:15.658173 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6eec34-e29d-40a6-88c6-6ec5890a0da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:15.658813 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eec34-e29d-40a6-88c6-6ec5890a0da7 None admin] REQUEST_METHOD: `PUT` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:15.659094 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eec34-e29d-40a6-88c6-6ec5890a0da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:15.659371 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6eec34-e29d-40a6-88c6-6ec5890a0da7 None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/60dba803c4c04821a18fa1e3fc6db104/roles/66779f51859f47aa886ee36ac8501a65` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:15.673862 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eec34-e29d-40a6-88c6-6ec5890a0da7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=60dba803c4c04821a18fa1e3fc6db104, role_id=66779f51859f47aa886ee36ac8501a65)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:15.675360 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6eec34-e29d-40a6-88c6-6ec5890a0da7 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:15.735677 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 613/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:15:15 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/60dba803c4c04821a18fa1e3fc6db104/roles/66779f51859f47aa886ee36ac8501a65 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:15:17.587097 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d028d-c565-419a-bf39-b924d27e86bd None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:17.587503 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d028d-c565-419a-bf39-b924d27e86bd None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:17.587642 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d028d-c565-419a-bf39-b924d27e86bd None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:17.588972 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 620/1233] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:15:17.594223 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f9211-a9b2-4a82-9b2f-102d7913b0af None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:17.594678 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f9211-a9b2-4a82-9b2f-102d7913b0af None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:17.594772 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f9211-a9b2-4a82-9b2f-102d7913b0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:17.612566 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-d22f9211-a9b2-4a82-9b2f-102d7913b0af None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:15:17.613740 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-d22f9211-a9b2-4a82-9b2f-102d7913b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:15:17.680133 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 614/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:15:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:15:17.950340 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d028d-c565-419a-bf39-b924d27e86bd None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:17.975392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:18.050290 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d028d-c565-419a-bf39-b924d27e86bd None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:18.084541 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7625448-3c9d-4818-84bb-27b42f31d5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:18.085159 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625448-3c9d-4818-84bb-27b42f31d5c8 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:18.085440 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625448-3c9d-4818-84bb-27b42f31d5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:18.085708 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625448-3c9d-4818-84bb-27b42f31d5c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:18.096079 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7625448-3c9d-4818-84bb-27b42f31d5c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-a7625448-3c9d-4818-84bb-27b42f31d5c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:15:18.100812 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:18.101937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:18.102872 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 621/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Tue Aug 23 07:15:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:18.108864 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f9211-a9b2-4a82-9b2f-102d7913b0af None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:18.153873 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:18.206671 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f9211-a9b2-4a82-9b2f-102d7913b0af None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:18.240319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7ddb0-ef72-4e3a-a3c8-0b93c84110ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:18.240920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7ddb0-ef72-4e3a-a3c8-0b93c84110ce None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:18.241200 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7ddb0-ef72-4e3a-a3c8-0b93c84110ce None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:18.241471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e7ddb0-ef72-4e3a-a3c8-0b93c84110ce None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:18.242151 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7ddb0-ef72-4e3a-a3c8-0b93c84110ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:18.242456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7ddb0-ef72-4e3a-a3c8-0b93c84110ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:18.243865 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e7ddb0-ef72-4e3a-a3c8-0b93c84110ce None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:18.251519 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 615/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Tue Aug 23 07:15:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:18.257224 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7625448-3c9d-4818-84bb-27b42f31d5c8 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:18.341421 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:18.357728 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7625448-3c9d-4818-84bb-27b42f31d5c8 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:18.391754 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4b0ef-3044-4a4d-b2c9-c6bb975e893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:18.392381 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b0ef-3044-4a4d-b2c9-c6bb975e893d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:18.392660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b0ef-3044-4a4d-b2c9-c6bb975e893d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:18.392933 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b0ef-3044-4a4d-b2c9-c6bb975e893d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:18.403630 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4b0ef-3044-4a4d-b2c9-c6bb975e893d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:18.405087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4b0ef-3044-4a4d-b2c9-c6bb975e893d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-69e4b0ef-3044-4a4d-b2c9-c6bb975e893d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:18.420699 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:18.421816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:18.422909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:18.422909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:18.422909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:18.422909 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 622/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:18.427712 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7ddb0-ef72-4e3a-a3c8-0b93c84110ce None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:18.526834 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e7ddb0-ef72-4e3a-a3c8-0b93c84110ce None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:18.536113 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:18.560328 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e02c0-924c-4904-922d-feef8f3be5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:18.560922 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e02c0-924c-4904-922d-feef8f3be5bb None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:18.561202 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e02c0-924c-4904-922d-feef8f3be5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:18.561471 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e02c0-924c-4904-922d-feef8f3be5bb None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:18.562137 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e02c0-924c-4904-922d-feef8f3be5bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:18.562438 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e02c0-924c-4904-922d-feef8f3be5bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:18.563839 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e02c0-924c-4904-922d-feef8f3be5bb None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:18.576107 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 616/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:18.582121 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4b0ef-3044-4a4d-b2c9-c6bb975e893d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:18.681426 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4b0ef-3044-4a4d-b2c9-c6bb975e893d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:18.715074 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ac620-48e7-492f-9196-b553a5551a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:18.715706 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ac620-48e7-492f-9196-b553a5551a17 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:18.715985 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ac620-48e7-492f-9196-b553a5551a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:18.716254 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ac620-48e7-492f-9196-b553a5551a17 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:18.718874 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:18.723800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ac620-48e7-492f-9196-b553a5551a17 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:18.725249 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ac620-48e7-492f-9196-b553a5551a17 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-e71ac620-48e7-492f-9196-b553a5551a17 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:15:18.736087 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:18.740632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:18.741840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:18.741840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:18.741840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:15:18.741840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:15:18.741840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:15:18.741840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:15:18.741840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:15:18.741840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:15:18.741840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:18.741840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:18.741840 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 623/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:18.743022 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e02c0-924c-4904-922d-feef8f3be5bb None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:18.841480 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e02c0-924c-4904-922d-feef8f3be5bb None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:18.873915 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc5e3f-50a6-4c63-8c45-3c7748a43caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:18.874533 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5e3f-50a6-4c63-8c45-3c7748a43caf None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:18.874817 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5e3f-50a6-4c63-8c45-3c7748a43caf None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:18.875087 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc5e3f-50a6-4c63-8c45-3c7748a43caf None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:18.875801 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc5e3f-50a6-4c63-8c45-3c7748a43caf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:18.876102 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc5e3f-50a6-4c63-8c45-3c7748a43caf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:18.877574 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc5e3f-50a6-4c63-8c45-3c7748a43caf None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:18.895470 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 617/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 07:15:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:18.901230 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ac620-48e7-492f-9196-b553a5551a17 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:19.001262 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ac620-48e7-492f-9196-b553a5551a17 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:19.034935 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf83435-7f62-4e18-b7ce-a2d4ae530d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:19.035570 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf83435-7f62-4e18-b7ce-a2d4ae530d8d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:19.035844 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf83435-7f62-4e18-b7ce-a2d4ae530d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:19.036110 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf83435-7f62-4e18-b7ce-a2d4ae530d8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:19.097987 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:19.104428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf83435-7f62-4e18-b7ce-a2d4ae530d8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:19.105918 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf83435-7f62-4e18-b7ce-a2d4ae530d8d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:19.205512 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 624/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:15:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:15:19.211415 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc5e3f-50a6-4c63-8c45-3c7748a43caf None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:19.238507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:19.309481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc5e3f-50a6-4c63-8c45-3c7748a43caf None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:19.343399 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91d727-d03d-47c7-bad3-accc9b38a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:19.344011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91d727-d03d-47c7-bad3-accc9b38a329 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:19.344289 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91d727-d03d-47c7-bad3-accc9b38a329 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:19.344558 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91d727-d03d-47c7-bad3-accc9b38a329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:19.354294 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91d727-d03d-47c7-bad3-accc9b38a329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:19.356199 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91d727-d03d-47c7-bad3-accc9b38a329 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-cc91d727-d03d-47c7-bad3-accc9b38a329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:19.371655 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:19.372799 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:19.373885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:19.373885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:19.373885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:19.374256 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 618/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:19.378392 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf83435-7f62-4e18-b7ce-a2d4ae530d8d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:19.468761 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:19.474336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf83435-7f62-4e18-b7ce-a2d4ae530d8d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:19.507770 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e025f80-f09f-427d-9117-ae765b79de29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:19.508367 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e025f80-f09f-427d-9117-ae765b79de29 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:19.508641 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e025f80-f09f-427d-9117-ae765b79de29 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:19.508914 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e025f80-f09f-427d-9117-ae765b79de29 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:19.509573 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e025f80-f09f-427d-9117-ae765b79de29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:19.509871 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e025f80-f09f-427d-9117-ae765b79de29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:19.511428 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e025f80-f09f-427d-9117-ae765b79de29 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:19.522530 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 625/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:19.528450 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91d727-d03d-47c7-bad3-accc9b38a329 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:19.610359 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:19.631479 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91d727-d03d-47c7-bad3-accc9b38a329 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:19.664156 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f78dc-6442-4b64-8ff8-57ad76f1389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:19.664764 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f78dc-6442-4b64-8ff8-57ad76f1389f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:19.665038 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f78dc-6442-4b64-8ff8-57ad76f1389f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:19.665305 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f78dc-6442-4b64-8ff8-57ad76f1389f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:19.672248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f78dc-6442-4b64-8ff8-57ad76f1389f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:19.673679 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f78dc-6442-4b64-8ff8-57ad76f1389f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-7c9f78dc-6442-4b64-8ff8-57ad76f1389f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:15:19.685062 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:19.686140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:19.687060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:15:19.687060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:15:19.687060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:15:19.687060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:15:19.687060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:15:19.687060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:15:19.687060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:19.687060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:19.687060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 619/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:15:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:19.692166 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e025f80-f09f-427d-9117-ae765b79de29 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:19.790523 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e025f80-f09f-427d-9117-ae765b79de29 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:19.822919 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad9059-97ff-43bb-999a-57a377ab4f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:19.823514 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9059-97ff-43bb-999a-57a377ab4f58 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:19.823981 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9059-97ff-43bb-999a-57a377ab4f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:19.824259 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9059-97ff-43bb-999a-57a377ab4f58 None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:19.824943 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad9059-97ff-43bb-999a-57a377ab4f58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:19.825245 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad9059-97ff-43bb-999a-57a377ab4f58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:19.826697 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad9059-97ff-43bb-999a-57a377ab4f58 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:19.838447 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 626/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:15:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:19.845179 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f78dc-6442-4b64-8ff8-57ad76f1389f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:19.945203 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f78dc-6442-4b64-8ff8-57ad76f1389f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:19.978906 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c3db6-4833-449d-ad55-78bbc3bc9b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:19.979494 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c3db6-4833-449d-ad55-78bbc3bc9b3a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:19.979775 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c3db6-4833-449d-ad55-78bbc3bc9b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:19.980667 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c3db6-4833-449d-ad55-78bbc3bc9b3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:19.981479 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c3db6-4833-449d-ad55-78bbc3bc9b3a None admin] RBAC: Adding query filter params (role.id=66779f51859f47aa886ee36ac8501a65, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=60dba803c4c04821a18fa1e3fc6db104) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:19.981789 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c3db6-4833-449d-ad55-78bbc3bc9b3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:19.983257 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c3db6-4833-449d-ad55-78bbc3bc9b3a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:19.988959 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 620/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:15:19 2022] GET /identity/v3/role_assignments?user.id=60dba803c4c04821a18fa1e3fc6db104&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=66779f51859f47aa886ee36ac8501a65 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:21.947223 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571445e-eda0-4846-89a8-513e7abe3c03 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:21.947842 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571445e-eda0-4846-89a8-513e7abe3c03 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:21.947842 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571445e-eda0-4846-89a8-513e7abe3c03 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:21.949822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 627/1247] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:15:21.955206 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c819d-cec3-43f4-a810-bb5cfd3d6e33 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:21.955632 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c819d-cec3-43f4-a810-bb5cfd3d6e33 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:21.955756 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c819d-cec3-43f4-a810-bb5cfd3d6e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:21.962092 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:21.974755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-055c819d-cec3-43f4-a810-bb5cfd3d6e33 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:15:21.975974 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-055c819d-cec3-43f4-a810-bb5cfd3d6e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:15:22.041911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 621/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:15:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:15:22.313270 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571445e-eda0-4846-89a8-513e7abe3c03 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:22.331978 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:22.413599 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571445e-eda0-4846-89a8-513e7abe3c03 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:22.451584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074182a-ca46-4897-958a-09e2aa88236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:22.452317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074182a-ca46-4897-958a-09e2aa88236f None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:22.452637 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074182a-ca46-4897-958a-09e2aa88236f None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:22.452946 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074182a-ca46-4897-958a-09e2aa88236f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:22.463323 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074182a-ca46-4897-958a-09e2aa88236f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-8074182a-ca46-4897-958a-09e2aa88236f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:15:22.467949 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:22.472517 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:22.473612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 628/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:15:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:22.475885 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c819d-cec3-43f4-a810-bb5cfd3d6e33 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:22.576124 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c819d-cec3-43f4-a810-bb5cfd3d6e33 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:22.605381 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:22.610481 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ecd4d-6dbe-4fad-8dff-0adc80aa757f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:22.611081 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ecd4d-6dbe-4fad-8dff-0adc80aa757f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:22.611359 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ecd4d-6dbe-4fad-8dff-0adc80aa757f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:22.611627 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ecd4d-6dbe-4fad-8dff-0adc80aa757f None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:22.612280 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ecd4d-6dbe-4fad-8dff-0adc80aa757f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:22.612579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ecd4d-6dbe-4fad-8dff-0adc80aa757f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:22.613931 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ecd4d-6dbe-4fad-8dff-0adc80aa757f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:22.622410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 622/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:15:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:22.628158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074182a-ca46-4897-958a-09e2aa88236f None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:22.704497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:22.727407 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074182a-ca46-4897-958a-09e2aa88236f None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:22.762756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74583ead-c328-491d-ab17-c2187d229916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:22.763402 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74583ead-c328-491d-ab17-c2187d229916 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:22.763678 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74583ead-c328-491d-ab17-c2187d229916 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:22.763947 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74583ead-c328-491d-ab17-c2187d229916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:22.774094 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74583ead-c328-491d-ab17-c2187d229916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:22.775538 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74583ead-c328-491d-ab17-c2187d229916 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-74583ead-c328-491d-ab17-c2187d229916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:22.791324 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:22.793065 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:22.793983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:22.793983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:22.793983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:22.793983 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 629/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:22.799258 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ecd4d-6dbe-4fad-8dff-0adc80aa757f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:22.898322 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ecd4d-6dbe-4fad-8dff-0adc80aa757f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:22.931560 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21e86-1092-4047-8d87-9057c124573f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:22.932155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21e86-1092-4047-8d87-9057c124573f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:22.932434 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21e86-1092-4047-8d87-9057c124573f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:22.932704 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21e86-1092-4047-8d87-9057c124573f None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:22.933347 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21e86-1092-4047-8d87-9057c124573f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:22.933636 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21e86-1092-4047-8d87-9057c124573f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:22.935028 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21e86-1092-4047-8d87-9057c124573f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:22.947021 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 623/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:22.952928 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74583ead-c328-491d-ab17-c2187d229916 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:23.051835 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74583ead-c328-491d-ab17-c2187d229916 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:23.077321 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:23.085098 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16f05-1cfe-4777-9d7d-93ed53a526dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:23.085727 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16f05-1cfe-4777-9d7d-93ed53a526dd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:23.085985 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16f05-1cfe-4777-9d7d-93ed53a526dd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:23.086281 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16f05-1cfe-4777-9d7d-93ed53a526dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:23.094319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab16f05-1cfe-4777-9d7d-93ed53a526dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:23.095819 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab16f05-1cfe-4777-9d7d-93ed53a526dd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-dab16f05-1cfe-4777-9d7d-93ed53a526dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:15:23.107158 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:23.111291 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:23.112473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:23.112473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:23.112473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:15:23.112473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:15:23.112473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:15:23.112473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:15:23.112473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:15:23.112473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:15:23.112473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:23.112473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:23.112473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 630/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:23.114366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21e86-1092-4047-8d87-9057c124573f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:23.169128 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:23.213494 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21e86-1092-4047-8d87-9057c124573f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:23.247021 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e7653-cceb-40c4-9247-f62b85b04611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:23.247613 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e7653-cceb-40c4-9247-f62b85b04611 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:23.247903 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e7653-cceb-40c4-9247-f62b85b04611 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:23.248153 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e7653-cceb-40c4-9247-f62b85b04611 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:23.248878 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e7653-cceb-40c4-9247-f62b85b04611 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:23.249168 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e7653-cceb-40c4-9247-f62b85b04611 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:23.250609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e7653-cceb-40c4-9247-f62b85b04611 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:23.267289 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 624/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 07:15:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:23.273147 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16f05-1cfe-4777-9d7d-93ed53a526dd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:23.372900 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16f05-1cfe-4777-9d7d-93ed53a526dd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:23.405036 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823533f-ecb8-4f62-9a45-c83d9168749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:23.405624 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823533f-ecb8-4f62-9a45-c83d9168749d None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:23.405898 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823533f-ecb8-4f62-9a45-c83d9168749d None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:23.406191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823533f-ecb8-4f62-9a45-c83d9168749d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:23.459261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:23.471441 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823533f-ecb8-4f62-9a45-c83d9168749d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:23.472865 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823533f-ecb8-4f62-9a45-c83d9168749d None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:23.569683 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 631/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:15:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:15:23.575653 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e7653-cceb-40c4-9247-f62b85b04611 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:23.676395 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e7653-cceb-40c4-9247-f62b85b04611 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:23.689273 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:23.711539 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bef2a-1eb7-4303-b351-8dd0c0cfe74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:23.712079 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bef2a-1eb7-4303-b351-8dd0c0cfe74f None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:23.712353 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bef2a-1eb7-4303-b351-8dd0c0cfe74f None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:23.712619 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bef2a-1eb7-4303-b351-8dd0c0cfe74f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:23.722733 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bef2a-1eb7-4303-b351-8dd0c0cfe74f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:23.724151 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bef2a-1eb7-4303-b351-8dd0c0cfe74f None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-9d4bef2a-1eb7-4303-b351-8dd0c0cfe74f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:23.738440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:23.739542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:23.740507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:23.740507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:23.740507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:23.740507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 625/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:23.745245 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823533f-ecb8-4f62-9a45-c83d9168749d None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:23.832164 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:23.844047 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823533f-ecb8-4f62-9a45-c83d9168749d None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:23.875997 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead7d49-3b8b-4171-a03e-d0be1fac6c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:23.876621 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7d49-3b8b-4171-a03e-d0be1fac6c13 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:23.876889 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7d49-3b8b-4171-a03e-d0be1fac6c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:23.877142 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead7d49-3b8b-4171-a03e-d0be1fac6c13 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:23.877791 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead7d49-3b8b-4171-a03e-d0be1fac6c13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:23.878072 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead7d49-3b8b-4171-a03e-d0be1fac6c13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:23.879452 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead7d49-3b8b-4171-a03e-d0be1fac6c13 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:23.891004 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 632/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:23.896688 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bef2a-1eb7-4303-b351-8dd0c0cfe74f None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:23.997125 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bef2a-1eb7-4303-b351-8dd0c0cfe74f None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:24.030712 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750940ca-938c-42f1-847f-515c6f54d24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:24.031405 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750940ca-938c-42f1-847f-515c6f54d24a None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:24.031685 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750940ca-938c-42f1-847f-515c6f54d24a None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:24.031956 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750940ca-938c-42f1-847f-515c6f54d24a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:24.038514 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750940ca-938c-42f1-847f-515c6f54d24a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:24.039945 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750940ca-938c-42f1-847f-515c6f54d24a None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-750940ca-938c-42f1-847f-515c6f54d24a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:15:24.051622 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:24.056140 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:24.057244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:15:24.057244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:15:24.057244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:15:24.057244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:15:24.057244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:15:24.057244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:15:24.057244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:24.057244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:24.057244 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 626/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:15:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:24.059412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead7d49-3b8b-4171-a03e-d0be1fac6c13 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:24.162146 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead7d49-3b8b-4171-a03e-d0be1fac6c13 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:24.195365 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7b611-7b18-42b0-b009-5b83324555dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:24.195961 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7b611-7b18-42b0-b009-5b83324555dd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:24.196243 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7b611-7b18-42b0-b009-5b83324555dd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:24.196513 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7b611-7b18-42b0-b009-5b83324555dd None admin] PATH_INFO: `/v3/projects` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:24.197284 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7b611-7b18-42b0-b009-5b83324555dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:24.197583 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7b611-7b18-42b0-b009-5b83324555dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:24.199647 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7b611-7b18-42b0-b009-5b83324555dd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:24.211612 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 633/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:15:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:24.218581 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750940ca-938c-42f1-847f-515c6f54d24a None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:24.244354 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:24.318609 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750940ca-938c-42f1-847f-515c6f54d24a None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:24.352640 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04042d17-9be0-4f3a-a7c7-91609f0987a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:24.353489 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04042d17-9be0-4f3a-a7c7-91609f0987a0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:24.354410 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04042d17-9be0-4f3a-a7c7-91609f0987a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:24.355657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04042d17-9be0-4f3a-a7c7-91609f0987a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:24.356828 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04042d17-9be0-4f3a-a7c7-91609f0987a0 None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=60dba803c4c04821a18fa1e3fc6db104) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:24.357143 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04042d17-9be0-4f3a-a7c7-91609f0987a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:24.358607 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04042d17-9be0-4f3a-a7c7-91609f0987a0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:24.364172 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 627/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:15:24 2022] GET /identity/v3/role_assignments?user.id=60dba803c4c04821a18fa1e3fc6db104&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=afe88bc03d30494b89892587177c79de => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:26.236984 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab9a4b-e63a-4595-98d0-3db593ebd970 None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:26.237516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab9a4b-e63a-4595-98d0-3db593ebd970 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:26.237516 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab9a4b-e63a-4595-98d0-3db593ebd970 None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:26.238873 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 634/1261] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:15:26.244101 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46425ffc-8347-4e21-842c-508fd513f314 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:26.244531 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46425ffc-8347-4e21-842c-508fd513f314 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:26.244627 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46425ffc-8347-4e21-842c-508fd513f314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:26.263240 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-46425ffc-8347-4e21-842c-508fd513f314 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:15:26.266731 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-46425ffc-8347-4e21-842c-508fd513f314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:15:26.330192 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 628/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:15:26.603394 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab9a4b-e63a-4595-98d0-3db593ebd970 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:26.614638 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:26.706622 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab9a4b-e63a-4595-98d0-3db593ebd970 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:26.739973 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8cd39-6bdc-4c68-9552-a8ee2915455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:26.740596 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8cd39-6bdc-4c68-9552-a8ee2915455c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:26.740867 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8cd39-6bdc-4c68-9552-a8ee2915455c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:26.741132 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8cd39-6bdc-4c68-9552-a8ee2915455c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:26.751372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8cd39-6bdc-4c68-9552-a8ee2915455c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-0ad8cd39-6bdc-4c68-9552-a8ee2915455c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:15:26.755968 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:26.758191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:26.759275 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 635/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:15:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:26.764289 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46425ffc-8347-4e21-842c-508fd513f314 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:26.782542 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:26.863765 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46425ffc-8347-4e21-842c-508fd513f314 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:26.896569 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62a0e0-38d5-4658-bde6-284e8cc730cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:26.897209 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62a0e0-38d5-4658-bde6-284e8cc730cd None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:26.897488 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62a0e0-38d5-4658-bde6-284e8cc730cd None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:26.897756 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62a0e0-38d5-4658-bde6-284e8cc730cd None admin] PATH_INFO: `/v3/roles` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:26.898438 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62a0e0-38d5-4658-bde6-284e8cc730cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:26.898738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62a0e0-38d5-4658-bde6-284e8cc730cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:26.900121 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62a0e0-38d5-4658-bde6-284e8cc730cd None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:26.907901 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 629/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:15:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:26.913602 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8cd39-6bdc-4c68-9552-a8ee2915455c None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:26.983618 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:27.016061 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8cd39-6bdc-4c68-9552-a8ee2915455c None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:27.048822 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29b5ee-a2c1-426a-8289-9e69136cbeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:27.049473 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29b5ee-a2c1-426a-8289-9e69136cbeef None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:27.049749 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29b5ee-a2c1-426a-8289-9e69136cbeef None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:27.050017 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29b5ee-a2c1-426a-8289-9e69136cbeef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:27.061094 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29b5ee-a2c1-426a-8289-9e69136cbeef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:27.062550 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29b5ee-a2c1-426a-8289-9e69136cbeef None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-7a29b5ee-a2c1-426a-8289-9e69136cbeef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:27.076412 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:27.078604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:27.080058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:27.080058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:27.080058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:27.080058 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 636/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:27.083729 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62a0e0-38d5-4658-bde6-284e8cc730cd None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:27.164128 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:27.183652 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62a0e0-38d5-4658-bde6-284e8cc730cd None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:27.221819 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e10c0-40bc-4c32-a341-48fb605c5b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:27.222444 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e10c0-40bc-4c32-a341-48fb605c5b73 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:27.222728 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e10c0-40bc-4c32-a341-48fb605c5b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:27.223000 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e10c0-40bc-4c32-a341-48fb605c5b73 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:27.223642 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e10c0-40bc-4c32-a341-48fb605c5b73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:27.223943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e10c0-40bc-4c32-a341-48fb605c5b73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:27.225299 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e10c0-40bc-4c32-a341-48fb605c5b73 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:27.237266 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 630/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:27.243341 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29b5ee-a2c1-426a-8289-9e69136cbeef None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:27.345101 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29b5ee-a2c1-426a-8289-9e69136cbeef None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:27.367490 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:27.381263 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45fa51-67c6-48db-996e-d383e3217ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:27.381892 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45fa51-67c6-48db-996e-d383e3217ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:27.382201 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45fa51-67c6-48db-996e-d383e3217ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:27.382476 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45fa51-67c6-48db-996e-d383e3217ef0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:27.390302 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45fa51-67c6-48db-996e-d383e3217ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:27.391742 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45fa51-67c6-48db-996e-d383e3217ef0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-2b45fa51-67c6-48db-996e-d383e3217ef0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:15:27.403585 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:27.404715 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:27.405839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:27.405839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:27.405839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:15:27.405839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:15:27.405839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:15:27.405839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:15:27.405839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:15:27.405839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:15:27.405839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:27.405839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:27.405839 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 637/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:27.410701 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e10c0-40bc-4c32-a341-48fb605c5b73 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:27.514907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e10c0-40bc-4c32-a341-48fb605c5b73 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:27.551155 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a938e4-1d0e-4eae-83da-2cfedc731ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:27.551762 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a938e4-1d0e-4eae-83da-2cfedc731ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:27.552046 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a938e4-1d0e-4eae-83da-2cfedc731ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:27.552315 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a938e4-1d0e-4eae-83da-2cfedc731ed0 None admin] PATH_INFO: `/v3/users` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:27.553437 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a938e4-1d0e-4eae-83da-2cfedc731ed0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:27.553992 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a938e4-1d0e-4eae-83da-2cfedc731ed0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:27.555815 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a938e4-1d0e-4eae-83da-2cfedc731ed0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:27.568911 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:27.578643 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 631/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 07:15:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:27.584416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45fa51-67c6-48db-996e-d383e3217ef0 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:27.689204 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45fa51-67c6-48db-996e-d383e3217ef0 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:27.723293 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c1e5d-faec-407f-8bc6-65e05f0cf859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:27.723918 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c1e5d-faec-407f-8bc6-65e05f0cf859 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:27.724193 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c1e5d-faec-407f-8bc6-65e05f0cf859 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:27.724456 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c1e5d-faec-407f-8bc6-65e05f0cf859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:27.736581 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c1e5d-faec-407f-8bc6-65e05f0cf859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:27.738004 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c1e5d-faec-407f-8bc6-65e05f0cf859 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-533c1e5d-faec-407f-8bc6-65e05f0cf859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:27.752372 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:27.753584 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:27.754737 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:27.754737 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:27.754737 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:27.754737 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 638/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:27.760074 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a938e4-1d0e-4eae-83da-2cfedc731ed0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:27.868837 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a938e4-1d0e-4eae-83da-2cfedc731ed0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:27.905752 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b78b0-2791-4d8d-ac63-955514a5bf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:27.906456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b78b0-2791-4d8d-ac63-955514a5bf99 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:27.906738 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b78b0-2791-4d8d-ac63-955514a5bf99 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:27.907011 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b78b0-2791-4d8d-ac63-955514a5bf99 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:27.907685 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b78b0-2791-4d8d-ac63-955514a5bf99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:27.907984 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b78b0-2791-4d8d-ac63-955514a5bf99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:27.909953 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b78b0-2791-4d8d-ac63-955514a5bf99 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:27.926109 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 632/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:27.932458 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c1e5d-faec-407f-8bc6-65e05f0cf859 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:27.969095 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:28.048192 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c1e5d-faec-407f-8bc6-65e05f0cf859 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:28.087398 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef2d81-5333-493b-8f24-f72f330891dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:28.088430 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef2d81-5333-493b-8f24-f72f330891dd None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:28.089298 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef2d81-5333-493b-8f24-f72f330891dd None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:28.089576 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ef2d81-5333-493b-8f24-f72f330891dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:28.098455 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef2d81-5333-493b-8f24-f72f330891dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:28.100203 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ef2d81-5333-493b-8f24-f72f330891dd None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-28ef2d81-5333-493b-8f24-f72f330891dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:15:28.116062 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:28.117220 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:28.118378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:15:28.118378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:15:28.118378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:15:28.118378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:15:28.118378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:15:28.118378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:15:28.118378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:28.118378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:28.118378 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 639/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:15:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:28.124288 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b78b0-2791-4d8d-ac63-955514a5bf99 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:28.192893 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:28.235227 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b78b0-2791-4d8d-ac63-955514a5bf99 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:28.267798 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba431bca-3840-4afc-b743-1c82e01a0a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:28.268393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba431bca-3840-4afc-b743-1c82e01a0a08 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:28.268674 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba431bca-3840-4afc-b743-1c82e01a0a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:28.268944 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba431bca-3840-4afc-b743-1c82e01a0a08 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:28.269737 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba431bca-3840-4afc-b743-1c82e01a0a08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:28.270044 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba431bca-3840-4afc-b743-1c82e01a0a08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:28.271492 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba431bca-3840-4afc-b743-1c82e01a0a08 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:28.284801 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 633/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:15:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:28.290892 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef2d81-5333-493b-8f24-f72f330891dd None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:28.382927 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:28.392787 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ef2d81-5333-493b-8f24-f72f330891dd None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:28.438130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ad7e0-3fed-4678-875a-67d2d6495383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:28.438130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ad7e0-3fed-4678-875a-67d2d6495383 None admin] REQUEST_METHOD: `PUT` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:28.438130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ad7e0-3fed-4678-875a-67d2d6495383 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:28.438130 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ad7e0-3fed-4678-875a-67d2d6495383 None admin] PATH_INFO: `/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/60dba803c4c04821a18fa1e3fc6db104/roles/afe88bc03d30494b89892587177c79de` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:28.438609 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ad7e0-3fed-4678-875a-67d2d6495383 None admin] RBAC: Authorizing `identity:create_grant(project_id=c5e2fff0bbff42ceb8e16f2f65280e06, user_id=60dba803c4c04821a18fa1e3fc6db104, role_id=afe88bc03d30494b89892587177c79de)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:28.438609 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ad7e0-3fed-4678-875a-67d2d6495383 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:28.576616 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 640/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Tue Aug 23 07:15:28 2022] PUT /identity/v3/projects/c5e2fff0bbff42ceb8e16f2f65280e06/users/60dba803c4c04821a18fa1e3fc6db104/roles/afe88bc03d30494b89892587177c79de => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 07:15:30.457501 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93379a-fc36-41a1-964a-cea435b7c550 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:30.458036 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93379a-fc36-41a1-964a-cea435b7c550 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:30.458036 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93379a-fc36-41a1-964a-cea435b7c550 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:30.459484 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 634/1274] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:15:30.465643 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6df3b-062a-4425-8cd1-def5c5bd1ca3 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:30.466059 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6df3b-062a-4425-8cd1-def5c5bd1ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:30.466259 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6df3b-062a-4425-8cd1-def5c5bd1ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:30.484924 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-2cc6df3b-062a-4425-8cd1-def5c5bd1ca3 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:15:30.486117 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-2cc6df3b-062a-4425-8cd1-def5c5bd1ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:15:30.558632 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 641/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:15:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:15:30.826952 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93379a-fc36-41a1-964a-cea435b7c550 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:30.926907 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93379a-fc36-41a1-964a-cea435b7c550 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:30.943773 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:30.960710 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953e996-8cb7-4ff3-b139-8168e69d9475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:30.961307 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953e996-8cb7-4ff3-b139-8168e69d9475 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:30.961585 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953e996-8cb7-4ff3-b139-8168e69d9475 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:30.961858 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953e996-8cb7-4ff3-b139-8168e69d9475 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:30.972521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953e996-8cb7-4ff3-b139-8168e69d9475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-0953e996-8cb7-4ff3-b139-8168e69d9475 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 07:15:30.977277 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:30.978464 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:30.979319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 635/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Tue Aug 23 07:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:30.984410 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6df3b-062a-4425-8cd1-def5c5bd1ca3 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:31.065819 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:31.084866 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6df3b-062a-4425-8cd1-def5c5bd1ca3 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:31.119703 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe4409-8d1c-4446-a789-9bda7cfb3633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:31.120788 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4409-8d1c-4446-a789-9bda7cfb3633 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:31.121068 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4409-8d1c-4446-a789-9bda7cfb3633 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:31.121338 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe4409-8d1c-4446-a789-9bda7cfb3633 None admin] PATH_INFO: `/v3/roles` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:31.121992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe4409-8d1c-4446-a789-9bda7cfb3633 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:31.122319 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe4409-8d1c-4446-a789-9bda7cfb3633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:31.123672 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe4409-8d1c-4446-a789-9bda7cfb3633 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:31.131413 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 642/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Tue Aug 23 07:15:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:31.137871 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953e996-8cb7-4ff3-b139-8168e69d9475 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:31.237138 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953e996-8cb7-4ff3-b139-8168e69d9475 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:31.272937 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a64d7f-174e-442c-9324-65ab9e0101db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:31.273557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a64d7f-174e-442c-9324-65ab9e0101db None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:31.274767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a64d7f-174e-442c-9324-65ab9e0101db None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:31.274767 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a64d7f-174e-442c-9324-65ab9e0101db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:31.284932 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a64d7f-174e-442c-9324-65ab9e0101db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:31.286421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a64d7f-174e-442c-9324-65ab9e0101db None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-f4a64d7f-174e-442c-9324-65ab9e0101db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:31.301350 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:31.302528 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:31.303461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:31.303461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:31.303461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:31.303461 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 636/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:31.309109 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe4409-8d1c-4446-a789-9bda7cfb3633 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:31.409014 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe4409-8d1c-4446-a789-9bda7cfb3633 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:31.442969 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e208d-85bb-48b5-9cc5-bc79fd6af426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:31.443568 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e208d-85bb-48b5-9cc5-bc79fd6af426 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:31.443844 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e208d-85bb-48b5-9cc5-bc79fd6af426 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:31.444111 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e208d-85bb-48b5-9cc5-bc79fd6af426 None admin] PATH_INFO: `/v3/domains` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:31.444741 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e208d-85bb-48b5-9cc5-bc79fd6af426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:31.445037 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e208d-85bb-48b5-9cc5-bc79fd6af426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:31.446408 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e208d-85bb-48b5-9cc5-bc79fd6af426 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:31.462165 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 643/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:31.468170 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a64d7f-174e-442c-9324-65ab9e0101db None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:31.499949 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:31.567393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a64d7f-174e-442c-9324-65ab9e0101db None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:31.603366 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee0a22-41d2-4580-80f1-61954db31cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:31.603990 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee0a22-41d2-4580-80f1-61954db31cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:31.604875 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee0a22-41d2-4580-80f1-61954db31cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:31.607758 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee0a22-41d2-4580-80f1-61954db31cf0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:31.613733 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee0a22-41d2-4580-80f1-61954db31cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:31.615262 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee0a22-41d2-4580-80f1-61954db31cf0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-8dee0a22-41d2-4580-80f1-61954db31cf0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 07:15:31.628913 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:31.630245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:31.631440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:31.631440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:31.631440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 07:15:31.631440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 07:15:31.631440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 07:15:31.631440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 07:15:31.631440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 07:15:31.631440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 07:15:31.631440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 07:15:31.631440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:31.631440 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 637/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:31.636797 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e208d-85bb-48b5-9cc5-bc79fd6af426 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:31.640956 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:31.747940 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e208d-85bb-48b5-9cc5-bc79fd6af426 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:31.783317 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d06f6-ae43-4ab2-bb8a-2f67c50daec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:31.783990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d06f6-ae43-4ab2-bb8a-2f67c50daec9 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:31.784312 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d06f6-ae43-4ab2-bb8a-2f67c50daec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:31.784609 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d06f6-ae43-4ab2-bb8a-2f67c50daec9 None admin] PATH_INFO: `/v3/users` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:31.785308 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d06f6-ae43-4ab2-bb8a-2f67c50daec9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:31.785604 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d06f6-ae43-4ab2-bb8a-2f67c50daec9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:31.787063 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d06f6-ae43-4ab2-bb8a-2f67c50daec9 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:31.808793 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 644/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Tue Aug 23 07:15:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:31.814728 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee0a22-41d2-4580-80f1-61954db31cf0 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:31.911644 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:31.921977 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee0a22-41d2-4580-80f1-61954db31cf0 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:31.957352 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81dff3-58a6-4e7b-9184-3f7a7dd27e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:31.957953 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81dff3-58a6-4e7b-9184-3f7a7dd27e80 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:31.958272 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81dff3-58a6-4e7b-9184-3f7a7dd27e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:31.958541 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81dff3-58a6-4e7b-9184-3f7a7dd27e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:32.030507 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81dff3-58a6-4e7b-9184-3f7a7dd27e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:32.032021 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81dff3-58a6-4e7b-9184-3f7a7dd27e80 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:32.122093 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:32.131839 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 638/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Tue Aug 23 07:15:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 07:15:32.137756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d06f6-ae43-4ab2-bb8a-2f67c50daec9 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:32.200268 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:32.238756 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d06f6-ae43-4ab2-bb8a-2f67c50daec9 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:32.273076 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51903001-0bad-4720-ad9d-5f38f85b5153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:32.273702 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903001-0bad-4720-ad9d-5f38f85b5153 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:32.273984 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903001-0bad-4720-ad9d-5f38f85b5153 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:32.274292 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903001-0bad-4720-ad9d-5f38f85b5153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:32.284942 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51903001-0bad-4720-ad9d-5f38f85b5153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:32.286345 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51903001-0bad-4720-ad9d-5f38f85b5153 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-51903001-0bad-4720-ad9d-5f38f85b5153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 07:15:32.300780 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:32.308330 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 07:15:32.309336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 07:15:32.309336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 07:15:32.309336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:32.309336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 645/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Tue Aug 23 07:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:32.309561 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81dff3-58a6-4e7b-9184-3f7a7dd27e80 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:32.405211 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81dff3-58a6-4e7b-9184-3f7a7dd27e80 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:32.439383 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63445d-9d85-4e7c-aed5-43ba5e7b6389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:32.439969 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63445d-9d85-4e7c-aed5-43ba5e7b6389 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:32.440258 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63445d-9d85-4e7c-aed5-43ba5e7b6389 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:32.440506 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb63445d-9d85-4e7c-aed5-43ba5e7b6389 None admin] PATH_INFO: `/v3/domains` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:32.441128 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63445d-9d85-4e7c-aed5-43ba5e7b6389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:32.441421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63445d-9d85-4e7c-aed5-43ba5e7b6389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:32.442816 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb63445d-9d85-4e7c-aed5-43ba5e7b6389 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:32.453943 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 639/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 23 07:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 07:15:32.459855 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51903001-0bad-4720-ad9d-5f38f85b5153 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:32.558188 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51903001-0bad-4720-ad9d-5f38f85b5153 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:32.571196 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:32.593992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c762d9-2987-47ba-b6a1-213fdb546fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:32.593992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c762d9-2987-47ba-b6a1-213fdb546fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:32.593992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c762d9-2987-47ba-b6a1-213fdb546fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:32.593992 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c762d9-2987-47ba-b6a1-213fdb546fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:32.599569 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c762d9-2987-47ba-b6a1-213fdb546fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:32.600823 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c762d9-2987-47ba-b6a1-213fdb546fc7 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application [None req-b1c762d9-2987-47ba-b6a1-213fdb546fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 07:15:32.613070 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:32.614191 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:32.615488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 07:15:32.615488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 07:15:32.615488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 07:15:32.615488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 07:15:32.615488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 07:15:32.615488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 07:15:32.615488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 07:15:32.615488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: ERROR keystone.server.flask.application Aug 23 07:15:32.615488 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 646/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Tue Aug 23 07:15:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:32.620118 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63445d-9d85-4e7c-aed5-43ba5e7b6389 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:32.669536 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:32.718070 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb63445d-9d85-4e7c-aed5-43ba5e7b6389 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:32.750456 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2ac0f-4241-4148-ab4f-2107fb7907f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:32.751060 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2ac0f-4241-4148-ab4f-2107fb7907f0 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:32.751597 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2ac0f-4241-4148-ab4f-2107fb7907f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:32.752108 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2ac0f-4241-4148-ab4f-2107fb7907f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:32.753344 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2ac0f-4241-4148-ab4f-2107fb7907f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:32.753657 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2ac0f-4241-4148-ab4f-2107fb7907f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:32.755115 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2ac0f-4241-4148-ab4f-2107fb7907f0 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:32.767743 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 640/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 23 07:15:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:32.773877 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c762d9-2987-47ba-b6a1-213fdb546fc7 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:32.870518 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c762d9-2987-47ba-b6a1-213fdb546fc7 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:32.903261 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb71e1-a119-47f5-9fbb-99e7c834f60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:32.903844 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb71e1-a119-47f5-9fbb-99e7c834f60c None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:32.904117 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb71e1-a119-47f5-9fbb-99e7c834f60c None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:32.904425 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb71e1-a119-47f5-9fbb-99e7c834f60c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:32.905134 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb71e1-a119-47f5-9fbb-99e7c834f60c None admin] RBAC: Adding query filter params (role.id=afe88bc03d30494b89892587177c79de, scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06, user.id=60dba803c4c04821a18fa1e3fc6db104) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:32.905433 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb71e1-a119-47f5-9fbb-99e7c834f60c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:32.906862 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb71e1-a119-47f5-9fbb-99e7c834f60c None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:32.912427 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 647/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Tue Aug 23 07:15:32 2022] GET /identity/v3/role_assignments?user.id=60dba803c4c04821a18fa1e3fc6db104&scope.project.id=c5e2fff0bbff42ceb8e16f2f65280e06&role.id=afe88bc03d30494b89892587177c79de => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:34.827709 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a6f36-dac4-4693-99d5-499149b3e71a None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:34.828248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a6f36-dac4-4693-99d5-499149b3e71a None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:34.828248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a6f36-dac4-4693-99d5-499149b3e71a None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:34.829844 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 641/1288] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:15:34.835168 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b49bf9-dd88-4f19-bb69-3e8c303c0d16 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:34.835539 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b49bf9-dd88-4f19-bb69-3e8c303c0d16 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:34.835660 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b49bf9-dd88-4f19-bb69-3e8c303c0d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:34.853814 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-83b49bf9-dd88-4f19-bb69-3e8c303c0d16 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:15:34.855301 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-83b49bf9-dd88-4f19-bb69-3e8c303c0d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:15:34.884416 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:34.920675 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 648/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:15:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:15:35.190482 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a6f36-dac4-4693-99d5-499149b3e71a None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:35.290319 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a6f36-dac4-4693-99d5-499149b3e71a None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:35.301570 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:35.324809 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22863f08-54bc-4482-9bd8-3afa3a000d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:35.325421 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22863f08-54bc-4482-9bd8-3afa3a000d5d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:35.325699 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22863f08-54bc-4482-9bd8-3afa3a000d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:35.325968 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22863f08-54bc-4482-9bd8-3afa3a000d5d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:35.326581 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22863f08-54bc-4482-9bd8-3afa3a000d5d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:35.327967 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22863f08-54bc-4482-9bd8-3afa3a000d5d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-22863f08-54bc-4482-9bd8-3afa3a000d5d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:35.336754 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:35.342602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:35.343621 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 642/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 07:15:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:35.344613 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b49bf9-dd88-4f19-bb69-3e8c303c0d16 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:35.441627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b49bf9-dd88-4f19-bb69-3e8c303c0d16 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:35.475902 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0c07f-4a5f-456b-b7c9-3ccb1ee5e4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:35.476557 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0c07f-4a5f-456b-b7c9-3ccb1ee5e4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:35.476818 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0c07f-4a5f-456b-b7c9-3ccb1ee5e4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:35.477085 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0c07f-4a5f-456b-b7c9-3ccb1ee5e4c5 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:35.477705 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0c07f-4a5f-456b-b7c9-3ccb1ee5e4c5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:35.478005 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0c07f-4a5f-456b-b7c9-3ccb1ee5e4c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:35.479520 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0c07f-4a5f-456b-b7c9-3ccb1ee5e4c5 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:35.484231 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 649/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 23 07:15:35 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:35.490052 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22863f08-54bc-4482-9bd8-3afa3a000d5d None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:35.589715 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22863f08-54bc-4482-9bd8-3afa3a000d5d None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:35.623678 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee522c-0dc9-481d-9045-3b9aa15296c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:35.624269 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee522c-0dc9-481d-9045-3b9aa15296c2 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:35.624545 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee522c-0dc9-481d-9045-3b9aa15296c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:35.624812 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee522c-0dc9-481d-9045-3b9aa15296c2 None admin] PATH_INFO: `/v3/services` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:35.625476 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee522c-0dc9-481d-9045-3b9aa15296c2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:35.625773 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee522c-0dc9-481d-9045-3b9aa15296c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:35.627205 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee522c-0dc9-481d-9045-3b9aa15296c2 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:35.631467 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 643/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 23 07:15:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:37.534484 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43eff5-03f9-4e10-a3b7-44e589d1c51d None None] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:37.535013 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43eff5-03f9-4e10-a3b7-44e589d1c51d None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:37.535013 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43eff5-03f9-4e10-a3b7-44e589d1c51d None None] PATH_INFO: `/` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:37.536366 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 650/1293] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:15:37.542093 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10028bc-adab-4ca1-9b80-b1a8d8393130 None None] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:37.542602 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10028bc-adab-4ca1-9b80-b1a8d8393130 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:37.542690 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10028bc-adab-4ca1-9b80-b1a8d8393130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:37.561110 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.auth.core [None req-e10028bc-adab-4ca1-9b80-b1a8d8393130 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81572) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:15:37.562343 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.fernet_utils [None req-e10028bc-adab-4ca1-9b80-b1a8d8393130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81572) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:15:37.592108 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:37.629509 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 644/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:15:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:15:37.902084 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43eff5-03f9-4e10-a3b7-44e589d1c51d None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:37.932990 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:38.003560 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43eff5-03f9-4e10-a3b7-44e589d1c51d None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:38.036668 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4daeae-7cfb-4d1b-a44e-b3313de601a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:38.037270 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4daeae-7cfb-4d1b-a44e-b3313de601a2 None admin] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:38.037547 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4daeae-7cfb-4d1b-a44e-b3313de601a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:38.037816 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4daeae-7cfb-4d1b-a44e-b3313de601a2 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:38.038471 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4daeae-7cfb-4d1b-a44e-b3313de601a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:38.039820 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4daeae-7cfb-4d1b-a44e-b3313de601a2 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:38.129257 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 651/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Tue Aug 23 07:15:37 2022] POST /identity/v3/services => generated 246 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 07:15:40.032493 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fe720-d51d-4372-bc23-ff965ae0c420 None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:40.033057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fe720-d51d-4372-bc23-ff965ae0c420 None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:40.033057 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405fe720-d51d-4372-bc23-ff965ae0c420 None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:40.034417 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 645/1296] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:15:40.039738 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cdd0-1c21-453e-970b-342dcdbb54a5 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:40.040159 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cdd0-1c21-453e-970b-342dcdbb54a5 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:40.040293 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182cdd0-1c21-453e-970b-342dcdbb54a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:40.058930 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-e182cdd0-1c21-453e-970b-342dcdbb54a5 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:15:40.060129 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-e182cdd0-1c21-453e-970b-342dcdbb54a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:15:40.132589 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 652/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:15:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:15:40.403255 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fe720-d51d-4372-bc23-ff965ae0c420 None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:40.504123 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405fe720-d51d-4372-bc23-ff965ae0c420 None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:40.537924 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935cea2-3ab0-45d2-bbe6-631485b2e5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:40.538560 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935cea2-3ab0-45d2-bbe6-631485b2e5b5 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:40.541245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935cea2-3ab0-45d2-bbe6-631485b2e5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:40.541245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935cea2-3ab0-45d2-bbe6-631485b2e5b5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:40.541245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935cea2-3ab0-45d2-bbe6-631485b2e5b5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:40.541245 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935cea2-3ab0-45d2-bbe6-631485b2e5b5 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-e935cea2-3ab0-45d2-bbe6-631485b2e5b5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:40.549676 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:40.550891 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:40.551920 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 646/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 07:15:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:40.556825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182cdd0-1c21-453e-970b-342dcdbb54a5 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:40.575335 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:40.655963 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182cdd0-1c21-453e-970b-342dcdbb54a5 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:40.689388 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906afbb5-7d36-4d69-a8b4-27e61305ef09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:40.689980 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afbb5-7d36-4d69-a8b4-27e61305ef09 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:40.690287 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afbb5-7d36-4d69-a8b4-27e61305ef09 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:40.690555 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906afbb5-7d36-4d69-a8b4-27e61305ef09 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:40.691164 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afbb5-7d36-4d69-a8b4-27e61305ef09 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:40.691458 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afbb5-7d36-4d69-a8b4-27e61305ef09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:40.692800 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906afbb5-7d36-4d69-a8b4-27e61305ef09 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:40.698685 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 653/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 23 07:15:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:40.705004 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935cea2-3ab0-45d2-bbe6-631485b2e5b5 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:40.736544 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:40.804615 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935cea2-3ab0-45d2-bbe6-631485b2e5b5 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:40.839063 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27f9fb-1fe7-4b20-b306-50c93f4a143d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:40.839647 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27f9fb-1fe7-4b20-b306-50c93f4a143d None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:40.839923 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27f9fb-1fe7-4b20-b306-50c93f4a143d None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:40.840190 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27f9fb-1fe7-4b20-b306-50c93f4a143d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:40.840877 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27f9fb-1fe7-4b20-b306-50c93f4a143d None admin] RBAC: Adding query filter params (interface=public, service_id=7be3cffa1f534f43b7b35f73c16aebc8, region_id=RegionOne) {{(pid=81572) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:40.841177 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27f9fb-1fe7-4b20-b306-50c93f4a143d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:40.842553 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27f9fb-1fe7-4b20-b306-50c93f4a143d None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:40.847418 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 647/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Tue Aug 23 07:15:40 2022] GET /identity/v3/endpoints?service_id=7be3cffa1f534f43b7b35f73c16aebc8&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:40.853496 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906afbb5-7d36-4d69-a8b4-27e61305ef09 None admin] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:40.934958 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:40.953046 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906afbb5-7d36-4d69-a8b4-27e61305ef09 None admin] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:40.985497 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf73573-f3b4-4953-add2-9304470505a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:40.986090 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73573-f3b4-4953-add2-9304470505a0 None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:40.986393 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73573-f3b4-4953-add2-9304470505a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:40.986665 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73573-f3b4-4953-add2-9304470505a0 None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:40.987252 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf73573-f3b4-4953-add2-9304470505a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:40.992436 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf73573-f3b4-4953-add2-9304470505a0 None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:40.996162 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 654/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Tue Aug 23 07:15:40 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 07:15:42.886248 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2da3b-e3bf-4e08-afa0-8b854aa3bd7f None None] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:42.886860 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2da3b-e3bf-4e08-afa0-8b854aa3bd7f None None] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:42.886860 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2da3b-e3bf-4e08-afa0-8b854aa3bd7f None None] PATH_INFO: `/` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:42.888146 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 648/1302] 10.222.0.16 () {54 vars in 927 bytes} [Tue Aug 23 07:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 07:15:42.893391 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc3c7a-0bf2-4e9d-8b3a-c683972b2104 None None] REQUEST_METHOD: `POST` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:42.893801 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc3c7a-0bf2-4e9d-8b3a-c683972b2104 None None] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:42.893937 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc3c7a-0bf2-4e9d-8b3a-c683972b2104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:42.911726 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.auth.core [None req-1fbc3c7a-0bf2-4e9d-8b3a-c683972b2104 None None] MFA Rules not processed for user `97d2196009fa44f294707c6fd6554a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81573) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 07:15:42.915336 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.fernet_utils [None req-1fbc3c7a-0bf2-4e9d-8b3a-c683972b2104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81573) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 07:15:42.979208 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 655/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 23 07:15:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 07:15:43.247263 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2da3b-e3bf-4e08-afa0-8b854aa3bd7f None None] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:43.341521 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=100 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:43.347894 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2da3b-e3bf-4e08-afa0-8b854aa3bd7f None None] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:43.379970 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e20ee-e9ba-475f-b0fd-52e1b0403004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:43.380579 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e20ee-e9ba-475f-b0fd-52e1b0403004 None admin] REQUEST_METHOD: `GET` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:43.380848 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e20ee-e9ba-475f-b0fd-52e1b0403004 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:43.381114 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e20ee-e9ba-475f-b0fd-52e1b0403004 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:43.381684 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e20ee-e9ba-475f-b0fd-52e1b0403004 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:43.383043 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e20ee-e9ba-475f-b0fd-52e1b0403004 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application [None req-360e20ee-e9ba-475f-b0fd-52e1b0403004 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 07:15:43.392195 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 07:15:43.396870 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application with Lock( Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self._enter() Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application return self.creator() Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application created_value = creator( Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: ERROR keystone.server.flask.application Aug 23 07:15:43.397755 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 649/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Tue Aug 23 07:15:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 07:15:43.399418 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc3c7a-0bf2-4e9d-8b3a-c683972b2104 None None] Authenticating user token {{(pid=81573) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:43.475221 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=100 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:43.497379 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc3c7a-0bf2-4e9d-8b3a-c683972b2104 None None] Validating token access rules against request {{(pid=81573) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:43.531758 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9595a-9256-49cc-8bc9-9e5eac9f5c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81573) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:43.532353 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9595a-9256-49cc-8bc9-9e5eac9f5c3b None admin] REQUEST_METHOD: `GET` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:43.532627 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9595a-9256-49cc-8bc9-9e5eac9f5c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:43.532893 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9595a-9256-49cc-8bc9-9e5eac9f5c3b None admin] PATH_INFO: `/v3/services` {{(pid=81573) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:43.533505 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9595a-9256-49cc-8bc9-9e5eac9f5c3b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81573) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 07:15:43.533825 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9595a-9256-49cc-8bc9-9e5eac9f5c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:43.535179 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9595a-9256-49cc-8bc9-9e5eac9f5c3b None admin] RBAC: Authorization granted {{(pid=81573) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:43.540063 dv-cinder-854070-3-smb devstack@keystone.service[81573]: [pid: 81573|app: 0|req: 656/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Tue Aug 23 07:15:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 07:15:43.545875 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e20ee-e9ba-475f-b0fd-52e1b0403004 None admin] Authenticating user token {{(pid=81572) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 07:15:43.647573 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e20ee-e9ba-475f-b0fd-52e1b0403004 None admin] Validating token access rules against request {{(pid=81572) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 07:15:43.680162 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdbd941-8fc9-45fc-be46-503949e1f125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97d2196009fa44f294707c6fd6554a9d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81572) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 07:15:43.680750 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd941-8fc9-45fc-be46-503949e1f125 None admin] REQUEST_METHOD: `POST` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 07:15:43.681030 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd941-8fc9-45fc-be46-503949e1f125 None admin] SCRIPT_NAME: `/identity` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 07:15:43.681301 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdbd941-8fc9-45fc-be46-503949e1f125 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81572) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 07:15:43.682008 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbd941-8fc9-45fc-be46-503949e1f125 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 07:15:43.683393 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdbd941-8fc9-45fc-be46-503949e1f125 None admin] RBAC: Authorization granted {{(pid=81572) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 07:15:43.757557 dv-cinder-854070-3-smb devstack@keystone.service[81572]: [pid: 81572|app: 0|req: 650/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 23 07:15:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 07:15:53.537142 dv-cinder-854070-3-smb devstack@keystone.service[81573]: DEBUG dbcounter [-] [81573] Writing DB stats keystone:SELECT=30 {{(pid=81573) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 07:15:53.752988 dv-cinder-854070-3-smb devstack@keystone.service[81572]: DEBUG dbcounter [-] [81572] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81572) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}